mindscience.distributed.manager.get_data_parallel_world_size

mindscience.distributed.manager.get_data_parallel_world_size()[source]

Get the size of the data parallel group.

Returns

int. The total number of processes in the data parallel group.