Training Function

• Dataset
• Training Hyperparameters
• Training Metrics Monitoring
• Resumable Training After Breakpoint
• Checkpoint Saving and Loading
• Resume Training2.0
• Distributed Parallelism Training
• Training High Availability
• Memory Optimization
• Data Skip And Checkpoint Health Monitor
• Pre-trained Model Average Weight Consolidation
• Other Training Features