Function-Related

Q: The WikiText dataset download link is not available.

A: The official download link is not available, please follow the community Issue #IBV35D.

Q: How Do I Generate a Model Sharding Strategy File?

A: The model sharding strategy file documents the sharding strategy for model weights in distributed scenarios and is generally used when slicing weights offline. Configure only_save_strategy: True in the network yaml file, and then start the distributed task normally, then the distributed strategy file can be generated in the output/strategy/ directory. For details, please refer to the Tutorial on Slicing and Merging Distributed Weights.

Q: How Can I Do When socket.gaierror: [Errno -2] Name or service not known or socket.gaierror: [Errno -3] Temporary failure in name resolution is Reported in ranktable Generation File?

A: Starting from MindSpore Transformers r1.2.0 version, cluster startup is unified using msrun method, and ranktable startup method is deprecated.