mindscience.distributed.manager.get_tensor_parallel_rank

mindscience.distributed.manager.get_tensor_parallel_rank()[source]

Get the tensor parallel rank of the current process.

Returns

int. The rank of the current process within the tensor parallel group.