MindSpore Transformers

Introduction

Overall Structure
Models

Installation

Installation Guidelines

Full-process Guide to Large Models

Pretraining
Supervised Fine-Tuning (SFT)
Inference
Service Deployment

Features

Start Tasks
Ckpt Weights
Safetensors Weights
Configuration File Descriptions
Loading Hugging Face Model Configuration
Logs
Training Function
Inference Function
- Evaluation
- Quantization
Using Tokenizer

Advanced Development

Large Model Precision Optimization Guide
Large Model Performance Optimization Guide
Development Migration
API

Environment Variables

Environment Variable Descriptions

Contribution Guide

MindSpore Transformers Contribution Guidelines
Modelers Contribution Guidelines

FAQ

Model-Related FAQ
Feature-Related FAQ

RELEASE NOTES

Release Notes

MindSpore Transformers

»
Inference Function
View page source

Inference Function

Evaluation
Quantization

Previous Next

© Copyright MindSpore.

Built with Sphinx using a theme provided by Read the Docs.