Class EnWik9Dataset

Inheritance Relationships

Base Type

Class Documentation

class EnWik9Dataset : public mindspore::dataset::Dataset

A source dataset for reading and parsing EnWik9 dataset.

Public Functions

EnWik9Dataset(const std::vector<char> &dataset_dir, int64_t num_samples, ShuffleMode shuffle, int32_t num_shards, int32_t shard_id, const std::shared_ptr<DatasetCache> &cache)

Function to create a EnWik9Dataset.

Parameters
  • dataset_dir[in] Path to the root directory that contains the dataset.

  • num_samples[in] The number of samples to be included in the dataset.

  • shuffle[in] The mode for shuffling data every epoch. Can be any of: ShuffleMode.kFalse - No shuffling is performed. ShuffleMode.kFiles - Shuffle files only. ShuffleMode.kGlobal - Shuffle both the files and samples.

  • num_shards[in] Number of shards that the dataset should be divided into.

  • shard_id[in] The shard ID within num_shards. This argument should be specified only when num_shards is also specified.

  • cache[in] Tensor cache to use.

~EnWik9Dataset() override = default

Destructor of EnWik9Dataset.