← Questions

Design a backend that asks one LLM question of 100,000 documents

0
HarveySystem designLast asked Oct 2026

An AI system design interview question asked in Harvey's system design (LLM applications) round, last asked Oct 2026. It tests llm, batch processing and rate limiting.

A user picks a set of documents, up to 100,000, and types one question ("What is the governing law?"). The system asks a large language model that question about every document separately and returns a table with one row per document and…

Sign in to unlock this question

The full prompt, the worked answer and your own canvas or code with the AI tutor. New accounts get 5 credits: each one unlocks a question for good.

Where it's asked

What it tests

llm · batch processing · rate limiting · job scheduling

Your canvas and the AI tutor open when you unlock this question.