← Questions

Design review: a batched GPU inference API

0
AnthropicSystem designLast asked Sep 2026

An AI system design interview question asked in Anthropic's system design round, last asked Sep 2026. It tests design review, llm serving and batching.

You are handed a design doc for the service that puts a language model behind an API, and asked to review it as you would for the team. No diagram to draw: read it, find what breaks, rank it, and say what you would change.

Sign in to unlock this question

The full prompt, the worked answer and your own canvas or code with the AI tutor. New accounts get 5 credits: each one unlocks a question for good.

Where it's asked

  • Anthropic · System design · Last asked Sep 202655 min · Design discussion, often typed into a shared Google Doc rather than drawn; some rounds let you share any drawing tool · No AI

What it tests

design review · llm serving · batching · gpu

Your canvas and the AI tutor open when you unlock this question.