AI-agent security detection over streaming telemetryAI system designDesign a system in which an AI agent reads a stream of security telemetry and runs detections on it. About 1 TB of data arrives per day. It was asked like a traditional system…
Design an AI prompt playgroundAI system designDesign a web workspace where developers write prompts, run them against several models and settings, compare outputs side by side, and save and share versions.
Last asked Oct 2026
Design a distributed AI model downloaderAI system designGet a new multi-hundred-gigabyte model checkpoint onto thousands of GPU hosts as fast as possible without overloading the storage it comes from.
Batched LLM inference API over GPUsAI system designDesign an inference API that batches requests across GPUs efficiently. The discussion goes deep on a few axes: utilization, scaling under spikes, and separating prompt processing…
Design a GPU scheduling platformAI system designShare a large GPU cluster among research and production teams: queue training and inference jobs, enforce quotas and priorities, place jobs on topology-aware hardware, and preempt…
Last asked Sep 2026
+1
Design a video generation service on a scarce GPU poolAI system designUsers submit text-to-video requests that each need minutes of GPU time, and the GPU pool is limited and changes size. Design the request flow, scheduling and workers, how users…
Last asked Sep 2026
Design an LLM chatbot with RL-trained answersAI system designDesign a chatbot that answers users' questions in real time, built on a large language model. Cover the serving path (latency, streaming answers, scale), then the learning loop:…
Last asked Sep 2026
Rule-driven file review agentAI system designDesign an agent workflow that applies supplied rules to a file or contract: classify and recommend fixes, or revise a contract against dozens of rules while merging overlapping…
Last asked Sep 2026
+5
Design an AI chatbot appAI system designBuild a chatbot app on top of a hosted LLM API: conversations, streamed answers, history, and per-user usage limits.
Last asked Sep 2026
Design the security architecture for an LLM chatbotAI system designA company runs a customer-facing chatbot built on a language model. Design its security: protecting the bot from abuse and prompt injection, limiting the data it can see and the…
Last asked Sep 2026
Retrieve tables and notebooks for a data-aware coding agentAI system designAn internal coding agent helps employees write code and answer questions. When someone asks a data question, such as how a metric changed over some period, the agent first has to…
Last asked Sep 2026
Design durable execution for long-running agent queriesAI system designAn answer service runs each query in memory, but agentic queries can now take hours. Redesign it so a query keeps running and finishes after the browser disconnects, resumes after…
Last asked Sep 2026
Design a voice and chat AI receptionist for businessesAI system designBusinesses want an AI receptionist that answers their phone number and chats on their website, app and messaging channels. It answers from information the business has approved…
Last asked Sep 2026
Design retrieval for a coding agent over a code baseAI system designA coding agent is an LLM assistant that works inside a software code base: it reads code, answers questions about it and makes edits. It depends on retrieval to put the right code…
Last asked Sep 2026
Design a pipeline that distills reusable agent skillsAI system designEnterprise customers run AI agents on their own tasks. Design a pipeline that automatically extracts reusable skills from that usage: a skill is a named package of instructions…
Last asked Sep 2026
Turn company policies into step-by-step support instructionsAI system designDesign a retrieval-augmented system for customer support staff: given a user's issue, it reads the company's policies and produces step-by-step instructions the agent can follow…
Last asked Sep 2026
Design a RAG question-answering agent over a firm's documentsAI system designDesign a system that answers questions from a large, private collection of documents (for example a law firm's memos) with retrieval-augmented generation, citing the passages it…
Last asked Sep 2026
Design a music recommender driven by an LLM agentAI system designDesign a music recommendation product in which an LLM agent talks with the listener and suggests songs or playlists. Cover how the agent reaches the listener's history and the…
Last asked Aug 2026
Design a streaming AI feature for a large audienceAI system designA consumer product wants to add an AI feature whose answers stream to millions of users in real time. Design the path from the client to the model: how responses stream, how…
Last asked Aug 2026
+2
Design permission-aware enterprise searchAI system designDesign search across every app a company uses (Drive, Confluence, Slack, Jira, GitHub, email and more) from one search box, plus an assistant that answers from the results. Nobody…
Last asked Aug 2026
+1
Design a customer-service AI agent with tools and guardrailsAI system designYou built a small conversational agent with two tools for the take-home. Now design the real thing: a platform that runs AI agents for many consumer brands, over chat and voice…
Design an evaluation platform for a design-editing AI agentAI system designAn AI agent edits design files on request. Design the platform that evaluates it: the test cases, how an edited design is judged (automatic checks, model graders, human review)…
Last asked Jul 2026
Design a scalable, safe agentic systemAI system designDesign an agent system and talk through its problems with the interviewer: how it extends to more tools and tasks, how you keep its actions safe, and what you do when an agent…
Last asked Jul 2026
Design a text-to-SQL chatbot with access controlAI system designDesign a chatbot that turns questions into SQL over internal data. Make sure users only reach data they are allowed to see, and stop invented tables, unsafe statements and runaway…
Last asked Jul 2026
Build a RAG agent on the Mistral API, then defend its designAI system designWrite a small Python tool that answers questions over a local folder of Markdown and PDF files with retrieval-augmented generation: ingest and chunk the files, embed and index the…
Last asked Jul 2026
Design an LLM-based coding assistantAI system designDesign an AI coding assistant that helps developers inside their editor: completing code, answering questions about a codebase and making edits on request. Discuss how it gathers…
Last asked Jun 2026
Manage the context window in an applied LLM systemAI system designAn applied AI product keeps hitting the model's context limit. How do you decide what goes into the context on each call? Discuss retrieval, trimming and summarizing history…
Last asked Jun 2026
Design a system that turns Jira tickets into pull requestsAI system designDesign an automated system that picks up a Jira ticket, uses an AI coding agent to write the change in the right repository, and opens a pull request for review. Cover how tickets…
Last asked Jun 2026
Speed up object-backed APIs, then design LLM observabilityAI system designTwo parts. First, make slow API endpoints whose data lives in stored objects faster. Then design an observability platform for LLM applications: capturing traces of model calls…
Last asked Jun 2026
Design a multi-agent document search and visualization productAI system designDesign a product in which several AI agents work together to search a large collection of documents and present what they find visually. Cover how the work is split among agents…
Last asked Jun 2026
Design an LLM chat over SEC filingsAI system designDesign a chat assistant that answers analysts' questions from SEC filings. Cover ingesting and parsing the filings, chunking and indexing long documents with tables, retrieval…
Last asked Jun 2026
Design personalization memory for a chatbotAI system designDesign how an AI assistant remembers things about each user across conversations and uses them to personalize answers. Cover what to store and how it is extracted, retrieval at…
Last asked May 2026
Design an agent that investigates support tickets automaticallyAI system designDesign an AI agent that picks up incoming support or on-call tickets and investigates them before a human does: it reads the ticket, gathers evidence from logs, dashboards, code…
Last asked Apr 2026
Design an agent harness and its evaluation systemAI system designDesign the harness that runs an AI agent (the loop that calls the model, runs its tools and manages its context) together with the system that evaluates it. Cover how the agent…
Last asked Apr 2026
Design a PDF-to-Markdown inference API (sync and async)AI system designBuild a service that turns PDF files into Markdown out of three existing functions: one that splits a PDF into page images (CPU-heavy), an OCR model that reads a page image or a…
Last asked Apr 2026
Design an embeddable streaming chat interfaceAI system designFor a frontend role: design the interface for a chat agent that other products can embed. Cover the component's API, streaming the agent's replies as they are generated, how…
Last asked Apr 2026
Keep private code from leaking through a coding agentAI system designA company runs an AI coding agent over its private repositories. Design the safeguards that stop private source code from leaking: into model training data, into answers shown to…
Last asked Apr 2026
+5
Design a RAG system over company docsAI system designEmployees should be able to ask questions about internal documents (Drive, Confluence, Slack, GitHub) and get grounded answers with citations.
Last asked Mar 2026
Build an eval harness for local models served by OllamaAI system designA take-home of about four hours (AI coding tools allowed): write an evaluation harness that runs a set of test cases against language models served locally through Ollama, scores…
Last asked Mar 2026
Design a code review agentAI system designDesign an AI agent that reviews pull requests: it reads the diff and the surrounding code, leaves comments on bugs, risky changes and style problems, and may suggest fixes. Cover…
Last asked Mar 2026
Design an AI agent rollout for a global enterpriseAI system designA forward-deployed engineering design round. A large global company wants to adopt AI agents across its business. Design the agent and how it gets rolled out: which work it takes…
Last asked Mar 2026
Design an AI gatewayAI system designDesign a gateway that sits between a company's services and the language-model providers they call. Cover routing requests across providers and models, failover, rate limits and…
Last asked Feb 2026
Design a real-time AI voice agentAI system designDesign a system in which callers talk to an AI agent over the phone or in an app in real time: speech recognition, the language model, speech synthesis, keeping the response delay…
Last asked Feb 2026
Design guardrails and fallbacks for a reliable LLM serviceAI system designA product depends on calls to a large language model. Design the guardrails and fallback paths that keep it reliable: what you check on the way in and on the way out, what the…
Last asked Feb 2026
Design an agent workflow that produces a feature-length videoAI system designSketch how an agentic system could generate a coherent hour-long film from a short brief. Discuss how you break the work into scenes and shots, keep characters and story…
Last asked Feb 2026
Design a RAG assistant with agentic toolsAI system designDesign an assistant that answers questions with retrieval-augmented generation and can call tools to act or fetch more information. Cover indexing, retrieval and re-ranking, when…
Last asked Feb 2026
Design a chatbot over structured and unstructured company dataAI system designDesign an assistant that answers employees' questions from two kinds of sources: tables in databases and documents. Cover how a question is routed (query generation for tables…
Last asked Feb 2026
Design a multi-agent chat backendAI system designThe interviewer demos a ChatGPT-style product, then asks you to design its backend: a harness in which several agents work on one user request. Cover how a request is planned and…
Last asked Feb 2026
Design a grounded voice assistantAI system designDesign a voice assistant whose answers are grounded in trusted sources rather than made up. Cover speech recognition, understanding the request, retrieving the right information…
Last asked Jan 2026
Design a computer-use agentAI system designDesign an agent that operates a computer the way a person does: it looks at the screen, decides the next action and clicks or types until a task is done. Cover how the model…
Last asked Jan 2026
Fast expensive tokens versus slow cheap tokensAI system designAn LLM provider offers fast but expensive tokens and slow but cheap ones. How would you decide which to use for a product? Discuss which features need low latency, batch versus…
Last asked Jan 2026
Build a recommender, then a chatbot on top of itAI system design1. Build a recommendation system from scratch: data, candidate generation, ranking, evaluation and serving. 2. Now that it exists, build a conversational interface on top of it…
Last asked Jan 2026
Make LLM output match a word processor's formattingAI system designA writing assistant inside a word processor generates text that must fit the document's formatting: styles, headings, lists, tables. Design how you get the model to produce…
Last asked Jan 2026
Design email ranking and summarization for an inboxAI system designDesign features that rank a user's incoming email by importance and summarize messages and threads with a language model. Cover signals for ranking, training labels, the…
Last asked Jan 2026
Design an LLM chatbot: training data, rewards and deploymentAI system designDesign a chatbot built on a large language model and walk through its whole lifecycle. Go deep on three areas: how you build the training data (sources, filtering, labeling), how…
Last asked Jan 2026
Improve a chatbot's answers to questions it doesn't knowAI system designUsers ask a ChatGPT-style assistant questions it does not know the answer to. Design how the system notices these questions and gives better answers to them: what it does instead…
Last asked Dec 2025
Design a multimodal RAG assistantAI system designDesign an assistant that answers questions using retrieval over inputs of several kinds (text documents, images, tables or diagrams). Cover ingesting and embedding each kind, the…
Last asked Dec 2025
Design an LLM output quality validation systemAI system designDesign a system that checks the quality of a language model's answers before and after they reach users. Cover what "quality" means for the product, automatic checks and…
Design a RAG system end to endAI system designDesign a retrieval-augmented generation system from documents to answers: ingesting and chunking documents, embeddings and the index, retrieval and reranking, the prompt to the…
Last asked Sep 2025
Design an image generation productAI system designDesign a system that generates images (and possibly other media) from user prompts. Cover the model pipeline, serving on GPUs with acceptable latency and cost, safety filtering of…
Last asked Aug 2025
Design a retrieval-augmented generation systemAI system designDesign a RAG system: users ask questions and an LLM answers using documents retrieved from your corpus. Cover ingestion and chunking, embeddings and the index, retrieval and…
Last asked Aug 2025
Solve math questions with an LLM: tools and chainsAI system designHow would you build a system that answers math questions such as "what is 4 + 5?" or "what is the sum of 1 to 100?" with an LLM? Discuss when to let the model answer directly…
Last asked Jul 2025
KV cache eviction for million-token contextsAI system designDesign an eviction policy for serving very long contexts on limited GPU memory, comparing sliding windows, attention sinks, heavy-hitter eviction, quantization and tiered or…
+4
Design an LLM inference serving platformAI system designDesign the system that serves several large models to many customers with low latency and high GPU utilization.
Design a multi-tenant fine-tuning and LoRA serving platformAI system designA model provider lets customers fine-tune its open-weight models on their own data through an API, then call the fine-tuned models through the same chat endpoint. Most use LoRA…
Design an answer engine with citationsAI system designDesign an answer engine: a user asks a question in plain language and gets a direct, current answer written by a model, with numbered citations to the web pages it used, streaming…
Design an evaluation harness for a customer-support AI agentAI system designA company's AI agent answers its customers over chat and takes actions through tools (refunds, plan changes, escalations). Every prompt, model, tool or policy change can break it…
Apply model edits to a file with an AST and model routingAI system designAn AI code editor lets a user ask for a change; a strong model answers with a sketch of the edit (the changed functions, with comments standing in for untouched code). Design the…
Design review: checkpointing a large training runAI system designYou are reviewing the checkpointing design for a month-long training run. Critique it: what fails, what it costs, what you would change, and what the doc does not cover. You have…
Design review: rolling out a new model versionAI system designYou are reviewing a launch plan written by the serving team. Critique it: rank the risks, propose changes, and say what must be true before you would approve it. You have 45…
+1
Design an AI coding agent sandboxAI system designAgents run untrusted code for many users. Design isolated, fast-starting sandboxes with file and network controls.
+3
Design ChatGPTAI system designDesign a consumer chat product backed by a large language model: conversations, streamed replies, history across devices, at 100M weekly users.
