mindspore.communication.GlobalComm

View Source On Gitee
class mindspore.communication.GlobalComm[source]

World communication information. The GlobalComm is a global class. The members contain:

  • BACKEND : The communication library used, using "hccl" / "nccl" / "mccl" . "hccl" means Huawei Collective Communication Library(HCCL), "nccl" means NVIDIA Collective Communication Library(NCCL), "mccl" means MindSpore Collective Communication Library(MCCL).

  • WORLD_COMM_GROUP : Global communication domain, using "hccl_world_group" / "nccl_world_group" / "mccl_world_group" .