section 02 · status: live · 6 entries · updated 2026-08-27
Large Language Models
The technology that pulled AI into everyday life. How transformers actually work, what tokens are, how a raw internet-scale model becomes an assistant, why models hallucinate, and what scale does and doesn't buy.
live · attention weighing the context, then sampling the next token
- Transformers & attentionevery word looks at every other word
- Tokens & tokenizationthe atoms of model perception
- How LLMs are trainedfrom internet prediction to instruction following
- Context windows & memorythe model's whole world, measured in tokens
- Hallucinationfluent, confident, and wrong by design
- Scaling laws & small modelspredictable gains, surprising arrivals, shrinking costs