MindSpore Transformers

Introduction

  • Overall Structure
  • Models

Installation

  • Installation Guidelines

Full-process Guide to Large Models

  • Pretraining
  • Supervised Fine-Tuning (SFT)
  • Inference
  • Service Deployment

Features

  • Start Tasks
  • Ckpt Weights
  • Safetensors Weights
  • Configuration File Descriptions
  • Loading Hugging Face Model Configuration
  • Logs
  • Training Function
  • Inference Function
  • Using Tokenizer

Advanced Development

  • Large Model Precision Optimization Guide
  • Large Model Performance Optimization Guide
  • Development Migration
  • API

Environment Variables

  • Environment Variable Descriptions

Contribution Guide

  • MindSpore Transformers Contribution Guidelines
  • Modelers Contribution Guidelines

FAQ

  • Model-Related FAQ
  • Feature-Related FAQ
    • Q: The WikiText dataset download link is not available.
    • Q: How Do I Generate a Model Sharding Strategy File?
    • Q: How Can I Do When socket.gaierror: [Errno -2] Name or service not known or socket.gaierror: [Errno -3] Temporary failure in name resolution is Reported in ranktable Generation File?
    • Q: When installing MindSpore Transformers from source code, the download speed of dependency packages is slow. How can this be resolved?

RELEASE NOTES

  • Release Notes
MindSpore Transformers
  • »
  • Feature-Related FAQ
  • View page source

Feature-Related FAQ

View Source On Gitee

Q: The WikiText dataset download link is not available.

A: The official download link is not available, please follow the community Issue #IBV35D.


Q: How Do I Generate a Model Sharding Strategy File?

A: The model sharding strategy file documents the sharding strategy for model weights in distributed scenarios and is generally used when slicing weights offline. Configure only_save_strategy: True in the network yaml file, and then start the distributed task normally, then the distributed strategy file can be generated in the output/strategy/ directory. For details, please refer to the Tutorial on Slicing and Merging Distributed Weights.


Q: How Can I Do When socket.gaierror: [Errno -2] Name or service not known or socket.gaierror: [Errno -3] Temporary failure in name resolution is Reported in ranktable Generation File?

A: Starting from MindSpore Transformers r1.2.0 version, cluster startup is unified using msrun method, and ranktable startup method is deprecated.


Q: When installing MindSpore Transformers from source code, the download speed of dependency packages is slow. How can this be resolved?

A: The build.sh script uses the Tsinghua Mirror to download the Python packages required by MindSpore Transformers. To change the mirror source, you can modify the download command in build.sh: pip install mindformers*whl -i https://pypi.tuna.tsinghua.edu.cn/simple , replace the URL after -i with the address of your desired mirror source.


Previous Next

© Copyright MindSpore.

Built with Sphinx using a theme provided by Read the Docs.