This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM).
Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper.
In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.
Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper.
In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.
Show More
