File text.h

↰ Parent directory (include/ccsrc/minddata/dataset/include/dataset)

Definition (include/ccsrc/minddata/dataset/include/dataset/text.h)

• Program Listing for File text.h

Includes

• include/api/dual_abi_helper.h

• include/api/status.h (File status.h)

• include/dataset/constants.h (File constants.h)

• include/dataset/transforms.h (File transforms.h)

• memory

• optional

• string

• unordered_map

• utility

• vector

Included By

• File datasets.h

Namespaces

• mindspore

• mindspore::dataset

• mindspore::dataset::text

Classes

• Class SentencePieceVocab

• Class BasicTokenizer

• Class BertTokenizer

• Class CaseFold

• Class FilterWikipediaXML

• Class JiebaTokenizer

• Class Lookup

• Class Ngram

• Class NormalizeUTF8

• Class RegexReplace

• Class RegexTokenizer

• Class SentencePieceTokenizer

• Class SlidingWindow

• Class ToNumber

• Class ToVectors

• Class TruncateSequencePair

• Class UnicodeCharTokenizer

• Class UnicodeScriptTokenizer

• Class WhitespaceTokenizer

• Class WordpieceTokenizer

• Class Vocab

Typedefs

• Typedef mindspore::dataset::WordIdType

• Typedef mindspore::dataset::WordType