mindspore_lite.ModelExecutor

class mindspore_lite.ModelExecutor(executor=None)

The ModelExecutor class wraps multiple mindspore_lite models and implements their inference scheduling.

Parameters

executor (_c_lite_wrapper.ModelExecBind, optional) – ModelExecutor class wrapped with pybind11. Default: None.

get_inputs()

Obtains all input Tensors of the ModelExecutor.

Returns

list[Tensor], the input Tensor list of the ModelExecutor.

get_outputs()

" Obtains all output information Tensors of the ModelExecutor.

Returns

list[TensorMeta], the output TensorMeta list of the ModelExecutor.

predict(inputs, outputs=None)

Inference ModelExecutor.

Parameters

• inputs (list[Tensor]) – A list that includes all input Tensors in order.

• outputs (list[Tensor], optional) – A list that includes all output Tensors in order, this tensor include output data buffer.

Returns

list[Tensor], the output Tensor list of the ModelExecutor.

Raises

• TypeError – inputs is not a list.

• TypeError – outputs is not a list.

• TypeError – inputs is a list, but the elements are not Tensor.

• TypeError – outputs is a list, but the elements are not Tensor.

• RuntimeError – predict model failed.