mindscience.distributed.mappings.gather_from_hidden

mindscience.distributed.mappings.gather_from_hidden(x, group)

Gathers hidden-partitioned tensors along the last dimension.

Parameters

• x (Tensor) – Input tensor with hidden partitions along the last dimension.

• group (Union[CommGroup, CommGroupBase]) – Communication group for the operation.

Returns

Tensor with all hidden partitions gathered along the last dimension.