← Questions

Design an AI chatbot app with streaming replies and saved chats

0
OpenAIMicrosoftUber+3System designLast asked Oct 2026

An AI system design interview question asked in OpenAI's technical screen (system design) and at Baseten, Waymo and 3 more companies, last asked Oct 2026. It tests llm, chat and streaming.

Design an AI assistant chatbot web app built on a hosted LLM API. A signed-in user starts conversations, types a message, and sees the model's answer stream back token by token.

Sign in to unlock this question

The full prompt, the worked answer and your own canvas or code with the AI tutor. New accounts get 5 credits: each one unlocks a question for good.

Where it's asked

What it tests

llm · chat · streaming

Your canvas and the AI tutor open when you unlock this question.