Frequently Asked Questions

Model-related Issues

Git-LFS Installation

1. Obtain the corresponding git-lfs installation package from the following link.

2. Download and install:

   mkdir git-lfs
   cd git-lfs
   wget https://github.com/git-lfs/git-lfs/releases/download/v3.0.1/git-lfs-linux-arm64-v3.0.1.tar.gz --no-check-certificate
   tar zxvf git-lfs-linux-arm64-v3.0.1.tar.gz
   bash install.sh
   

3. Verify successful installation:

   git lfs install
   

   If Git LFS initialized. is returned, the installation was successful.

Deployment-related Issues

aclnnNonzeroV2 Related Error When Starting Online Inference

• Key error message:

  RuntimeError: Call aclnnNonzeroV2 failed, detail:E39999: Inner Error
  

  Check whether the CANN and MindSpore versions are correctly matched.

torch Not Found When Importing vllm_mindspore

• Key error message:

  importlib.metadata.PackageNotFoundError: No package metadata was found for torch
  

  Execute the following commands to uninstall torch-related components:

  pip uninstall torch
  pip uninstall torchvision