MindSpore Transformers

Introduction

  • Quick Start
  • Overall Structure
  • Model Support Library

Installation

  • Installation Guide

Training Guide

  • Training Guide

Function Features

  • Function Overview
  • Starting Tasks
  • Configuration File Description
  • Logs
  • Datasets
  • Hyperparameters and Optimizers for Training
  • Distributed Parallel Training
  • Training Graphics Memory Optimization
  • Weight Saving and Loading
  • Resumable Training
  • Training Metric Monitoring and Profiling
  • Other Training Features
  • Static Graph Features

Environment Variables

  • Environment Variables

Contribution Guide

  • MindSpore Transformers Contribution Guidelines
  • Modelers Contribution Guidelines

FAQ

  • Model-Related FAQ
  • Feature-Related FAQ

Static Graph Implementation (Deprecated)

  • Overall Structure
  • Full-process Guide to Large Models
  • Features
  • Advanced Development
    • Advanced Development Overview
    • Large Model Precision Optimization Guide
    • Large Model Performance Optimization Guide
    • Development Migration
    • Guide to Using the Inference Configuration Template
    • Comparison of Reasoning Precision
    • Comparing the Model Precision with that of Megatron-LM
    • Training Configuration Template Instruction
    • Weight Conversion Development Adaptation
    • API
  • Excellent Practice
  • Environment Variable Descriptions
MindSpore Transformers
  • »
  • Advanced Development
  • View page source

Advanced Development

  • Advanced Development Overview
  • Large Model Precision Optimization Guide
  • Large Model Performance Optimization Guide
  • Development Migration
  • Guide to Using the Inference Configuration Template
  • Comparison of Reasoning Precision
  • Comparing the Model Precision with that of Megatron-LM
  • Training Configuration Template Instruction
  • Weight Conversion Development Adaptation
  • API
Previous Next

© Copyright MindSpore.

Built with Sphinx using a theme provided by Read the Docs.