Active / Teaching artifacts, not a model release
AI research lab
Public experiments in understanding and explaining language-model systems.
Why it exists
I want a working model of how inference actually behaves, precise enough to teach, humble enough not to fake a benchmark.
Problem being investigated
Technical explanations drift. They recompute the prompt from scratch in the reader's imagination, they treat attention as comprehension, or they present sampling controls as if they were layers of the network.
Model
The active artifact is the prompt-to-token explainer: a pipeline, an attention sketch labeled as conceptual, a sampling playground labeled as illustrative, and a prefill/decode comparison that says "commonly" where the literature says the bottleneck depends.
Lessons
- The correction is often a sentence, not a new visualization. "Not recomputed from scratch" matters more than another animated neuron.
- Illustrative numbers have to be branded as illustrative in the same view as the chart, not in a footnote.