Harvey system design (LLM applications) interview

Round 5 of 7 · 5 questions reported

Length: 60 min
Format: Design discussion on a whiteboard or doc
They grade: Retrieval, evaluation, multi-tenancy, confidentiality between clients and faithful answers with citations
Heads-up: A reported prompt: answers over a law firm's private documents that cite the exact clause. Other loops get a document store with organization-level access control (like Harvey's Vault) instead, so prepare a storage design as well as a RAG design. Often held in the San Francisco office with the project walkthrough, while coding and values run over video.

Questions Harvey asks in this round 5

Document store with drive sync and org ACLsSystem designDesign a Drive-like document store with upload and download, large-file handling and organization-level access control; real-time multi-device sync is out of scope. Reported on…
Last asked Sep 2026
Design a RAG question-answering agent over a firm's documentsAI systemDesign a system that answers questions from a large, private collection of documents (for example a law firm's memos) with retrieval-augmented generation, citing the passages it…
Last asked Sep 2026
Rule-driven file review agentAI systemDesign an agent workflow that applies supplied rules to a file or contract: classify and recommend fixes, or revise a contract against dozens of rules while merging overlapping…
Last asked Sep 2026
Design Facebook MessengerSystem designOne-to-one and group messaging for a billion users: real-time delivery, offline sync, read receipts and message history on every device.
Last asked Sep 2026
Design a multi-agent system that redlines a contract against a playbookAI systemA law firm has a playbook of 30 to 80 rules for a contract type (liability caps, governing law, assignment, confidentiality terms). Given a counterparty's 50-page draft, produce a…