Class ModelGroup

• Defined in File model_group.h

Class Documentation

class ModelGroup

Public Functions

explicit ModelGroup(ModelGroupFlag flags = ModelGroupFlag::kShareWorkspace)

Constructor of ModelGroup.

参数

flags – [in] The flags of model group.

~ModelGroup() = default

Destructor of ModelGroup.

inline Status AddModel(const std::vector<std::string> &model_path_list)

Add models that require shared workspace memory.

参数

model_path_list – [in] Define the list of model path.

返回

Status.

Status AddModel(const std::vector<std::pair<const void*, size_t>> &model_buff_list)

Add models that require shared workspace memory.

参数

model_buff_list – [in] Define the list of model buff.

返回

Status.

Status AddModel(const std::vector<Model> &model_list)

Add models that require shared weight memory.

参数

model_list – [in] Define the list of model object.

返回

Status.

Status CalMaxSizeOfWorkspace(ModelType model_type, const std::shared_ptr<Context> &ms_context)

Calculate the max workspace of the added models.

参数

• model_type – [in] Define The type of model file. Options: ModelType::kMindIR_Lite, ModelType::kMindIR. Only ModelType::kMindIR_Lite is valid for Lite.

• ms_context – [in] A context used to store options.

返回

Status.