GlassBox
A whole transformer you can see into.
The same machinery as a large language model, shrunk to 1,352 numbers. Every stage of the forward pass is on screen with its real numbers: six tokens, eight numbers each, attention you can click, sixteen hidden units, forty-eight word scores, the next word. Click any number to see how it was computed, edit it, or train the model and watch the loss fall. An Explain tab shows why the model said what it said: its prediction forming layer by layer, what breaks when a part is switched off, and exact contributions from each part, with a check beside every result that must hold.
The app needs JavaScript. If it has not loaded, reload the page, or watch the two-minute introduction or the eight-minute narrated tour.
Built by Todd McCaffrey in Letterkenny. Part of the aihi.win project cards.