Tag: inference

All the articles with the tag "inference".

• Inference, Opened

  3 Oct, 2026

  A real language model runs in your browser tab. Follow one prompt through the tokenizer, embeddings, attention, the KV cache and the sampler, and see where every byte would move on a GPU server.