mindspore.dataset.text.Truncate

class mindspore.dataset.text.Truncate(max_seq_len)[source]

Truncate the input sequence so that it does not exceed the maximum length.

Parameters

max_seq_len (int) – Maximum allowable length.

Raises

TypeError – If max_length_len is not of type int.
ValueError – If value of max_length_len is not greater than or equal to 0.
RuntimeError – If the input tensor is not of dtype bool, int, float, double or str.

Supported Platforms:: CPU

Examples

>>> dataset = ds.NumpySlicesDataset(data=[['a', 'b', 'c', 'd', 'e']], column_names=["text"], shuffle=False)
>>> # Data before
>>> # |           col1            |
>>> # +---------------------------+
>>> # | ['a', 'b', 'c', 'd', 'e'] |
>>> # +---------------------------+
>>> truncate = text.Truncate(4)
>>> dataset = dataset.map(operations=truncate, input_columns=["text"])
>>> # Data after
>>> # |          col1          |
>>> # +------------------------+
>>> # |  ['a', 'b', 'c', 'd']  |
>>> # +------------------------+