MindSpore Transformers

Introduction

  • Overall Structure
  • Models

Installation

  • Installation Guidelines

Full-process Guide to Large Models

  • Pretraining
  • Supervised Fine-Tuning (SFT)
  • Inference
  • Service Deployment

Features

  • Start Tasks
  • Ckpt Weights
  • Safetensors Weights
  • Configuration File Descriptions
  • Loading Hugging Face Model Configuration
  • Logs
  • Training Function
  • Inference Function
  • Using Tokenizer

Advanced Development

  • Large Model Precision Optimization Guide
  • Large Model Performance Optimization Guide
  • Development Migration
  • Guide to Using the Inference Configuration Template
  • Comparing the Model Precision with that of Megatron-LM
  • API

Excellent Practice

  • Practice Case of Using DeepSeek-R1 for Model Distillation

Environment Variables

  • Environment Variable Descriptions

Contribution Guide

  • MindSpore Transformers Contribution Guidelines
  • Modelers Contribution Guidelines

FAQ

  • Model-Related FAQ
  • Feature-Related FAQ
MindSpore Transformers
  • »
  • Search

© Copyright MindSpore.

Built with Sphinx using a theme provided by Read the Docs.