LLM and generative AI system design interview questions

Candidates' reports name 107 LLM and generative AI system design questions at 31 AI companies. The most are at Anthropic (17), OpenAI (14) and Cohere (6). The most asked themes are LLM products and platforms (22), agents and tool use (21) and LLM inference and serving (20), and the newest was asked in Nov 2026. Each question below has the company, the round and when it was last asked.

Updated

Questions per company
CompanyQuestionsLast asked
Anthropic17Oct 2026
OpenAI14Oct 2026
Cohere6Oct 2026
Decagon6Sep 2026
Harvey6Oct 2026
Mercor6Sep 2026
Scale AI6Oct 2026
Mistral AI5Sep 2026
Lambda4Sep 2026
LangChain4Sep 2026
SpaceXAI4Feb 2026
Waymo4Sep 2026
Baseten3Oct 2026
Hebbia3Jun 2026
Modal3Sep 2026
Nuro3Oct 2026
Perplexity3Oct 2026
Applied Intuition2Nov 2026
Cognition2Sep 2026
Cursor2—
ElevenLabs2Nov 2026
Glean2Sep 2026
Google DeepMind2Nov 2026
Hugging Face2—
Sierra2Oct 2026
Together AI2Oct 2026
Abridge1Aug 2026
Character.AI1Nov 2025
Fireworks AI1Aug 2025
Rogo1Jun 2026
Runway1Aug 2025

LLM products and platforms 22

Agents and tool use 21

LLM inference and serving 20

Training, fine-tuning and GPUs 16

RAG, retrieval and search 14

Evals, safety and guardrails 14

More from the data