Integrated Solution for Training and Inference of Ascend AI Foundation Models Promotes Intelligent Development

On July 6, 2023, Ascend Artificial Intelligence Industry Summit Forum was held in Shanghai. At the Forum, Huawei and four partners jointly released the integrated solution for training and inference of Ascend AI foundation models, accelerating the application of foundation models in various industries.

With the rapid development of deep learning, an increasing number of scenarios require foundation models for training and inference. However, challenges such as hardware cluster switching, underlying hardware adaptation, and fine-tuning and optimization are haunting enterprises throughout foundation model development. In addition, the traditional development mode can no longer meet the requirements of the long R&D period and high deployment threshold of foundation models.

What Huawei and the four partners proposed serves as an out-of-the-box solution for addressing these challenges. In a cluster, the training and inference processes of foundation models can be seamlessly switched, facilitating foundation model training and inference for customers.

In addition, the solution has a built-in foundation model inference engine, optimization tool, and operator acceleration library, which require no secondary hardware adaptation. Customers can directly use the pre-trained foundation model, and the technical threshold is lowered.

Based on the basic software and hardware capabilities of Ascend AI and the advantages of partner models and platforms, Huawei embeds the algorithms and model capabilities of the four partners in foundation model training, fine-tuning, and optimization. Concerted efforts are made to jointly design, develop, launch, and continuously iterate the solution. In this way, the solution provided for customers is more comprehensive and meets requirements of various scenarios and industries.

The integrated solution for training and inference of Ascend AI foundation models reshapes the development process, maximizes the value of foundation models in the industry, and helps customers better apply deep-learning foundation models. In the future, Huawei will continue to work with partners to further integrate foundation models into the industry. Efficient solutions will be provided for more industries, accelerating the application implementation of various scenarios and industries.