FROM BLOG TO BROWSER

See attention.
Change the numbers.
Build intuition.

An interactive lab for the building blocks of language models. No AI API key required.

TokensQ · K · VAttention mapsPosition
Your emailed access code works for 48 hours from issue. Return anytime during that period.

Get your access code

Details are stored by this application for access management. This form does not subscribe you to marketing emails. For removal, contact the site operator through the channel that shared this lab.