mindscience.distributed.mappings.all_to_all_from_hidden_to_sequence
- mindscience.distributed.mappings.all_to_all_from_hidden_to_sequence(x, group)[source]
Performs an all-to-all from hidden layout to sequence layout.
- Parameters
x (Tensor) – Input tensor in hidden layout.
group (Union[CommGroup, CommGroupBase]) – Communication group for the operation.
- Returns
Tensor transformed from hidden layout to sequence layout.