Inference on a CPU

Linux CPU Inference Application Beginner Intermediate Expert

Inference Using a Checkpoint File

The inference is the same as that on the Ascend 910 AI processor.

Inference Using an ONNX File

Similar to the inference on a GPU, the following steps are required:

1. Generate a model in ONNX format on the training platform. For details, see Export ONNX Model.

2. Perform inference on a CPU by referring to the runtime or SDK document. For details about how to use the ONNX Runtime, see the ONNX Runtime document.