mindscience.common.get_2d_sin_cos_pos_embed

mindscience.common.get_2d_sin_cos_pos_embed(embed_dim, grid_size)

Construct 2D sine-cosine positional embeddings on a two-dimensional grid.

Parameters

• embed_dim (int) – The output dimension for each position.

• grid_size (tuple(int)) – The grid height and width.

Returns

Numpy.array, with shape \((1, grid\_height*grid\_width, embed\_dim)\) .