Tag: llm
All the articles with the tag "llm".
Inference, Opened
A real language model runs in your browser tab. Follow one prompt through the tokenizer, embeddings, attention, the KV cache and the sampler, and see where every byte would move on a GPU server.