← Questions

LLM generation simulator: autoregressive decoding, then dynamic batching

0
Ambience HealthcareCodingLast asked Sep 2026

Two small simulations of how a language model serves text, asked as one screen: first one sequence decoding token by token, then many sequences sharing a batch of decode slots. A model starts from the prompt tokens and appends one…

Sign in to unlock this question

The full prompt, the worked answer and your own canvas or code with the AI tutor. New accounts get 3 credits: each one unlocks a question for good.

Your code and the AI tutor open when you unlock this question.