mindscience.distributed.mappings.scatter_to_sequence

mindscience.distributed.mappings.scatter_to_sequence(x, group)[source]

Scatters tensors across the first dimension to form sequence partitions.

Parameters

x (Tensor) – Input tensor to be scattered into sequence partitions.
group (Union[CommGroup, CommGroupBase]) – Communication group for the operation.

Returns

Tensor partition corresponding to the current rank along the first dimension.