Hacker News
- You could have designed state of the art positional encoding https://fleetwood.dev/posts/you-could-have-designed-SOTA-positional-encoding 42 comments
Linked pages
- [1706.03762] Attention Is All You Need https://arxiv.org/abs/1706.03762 145 comments
- Rotation matrix - Wikipedia https://en.wikipedia.org/wiki/Rotation_matrix#Rotation_matrix_from_axis_and_angle 17 comments
- [2104.09864] RoFormer: Enhanced Transformer with Rotary Position Embedding https://arxiv.org/abs/2104.09864 8 comments
- Rotary Embeddings: A Relative Revolution | EleutherAI Blog https://blog.eleuther.ai/rotary-embeddings/ 1 comment
- Transformer Architecture: The Positional Encoding - Amirhossein Kazemnejad's Blog https://kazemnejad.com/blog/transformer_architecture_positional_encoding/ 0 comments
Related searches:
Search whole site: site:fleetwood.dev
Search title: You could have designed state of the art positional encoding
See how to search.