Enum SPieceTokenizerOutType

• Defined in File constants.h

Enum Documentation

enum class mindspore::dataset::SPieceTokenizerOutType

Possible options for SPieceTokenizerOutType.

Values:

enumerator kString

Output of sentencepiece tokenizer is string type.

enumerator kInt

Output of sentencepiece tokenizer is int type.