Implement 2D Positional Embeddings in PyTorch
Mediummodern-architecturesauto-graded
Build 2D sinusoidal position encodings for vision transformers, encoding both row and column positions in patch grids.
Solve it
Check your answer
The grader verifies properties of your implementation, so a correct solution written differently from ours still passes.
pip install torchleet
from torchleet import check
check("2d-positional-embeddings", create_2d_sinusoidal_embeddings)