MindSpore Transformers

Introduction

Overall Structure
Models

Installation

Installation Guidelines

Full-process Guide to Large Models

Pretraining
Supervised Fine-Tuning (SFT)
Inference
Service Deployment

Features

Start Tasks
Ckpt Weights
Safetensors Weights
Configuration File Descriptions
Loading Hugging Face Model Configuration
Logs
Training Function
Inference Function
Using Tokenizer

Advanced Development

Large Model Precision Optimization Guide
Large Model Performance Optimization Guide
Development Migration
Guide to Using the Inference Configuration Template
Comparing the Model Precision with that of Megatron-LM
API

Excellent Practice

Practice Case of Using DeepSeek-R1 for Model Distillation

Environment Variables

Environment Variable Descriptions

Contribution Guide

MindSpore Transformers Contribution Guidelines
Modelers Contribution Guidelines

FAQ

Model-Related FAQ
Feature-Related FAQ

MindSpore Transformers

»
API »
mindformers.modules
View page source

mindformers.modules

Operator-level parallel configuration

mindformers.modules.OpParallelConfig

Configuration for operator parallelism, used to set the method of operator-level parallelism.

Previous Next

© Copyright MindSpore.

Built with Sphinx using a theme provided by Read the Docs.