← Questions

Design a Kafka-based file watcher for millions of files

0
AmazonSystem designLast asked Sep 2026

Design a file watcher that tracks millions of files and publishes change events to downstream consumers through Kafka. Cover the first full discovery of files, ongoing changes, the order of events, recovery after a crash, and how you catch changes that the operating system's file notifications miss.

Your canvas
Draw your answer hereBoxes, arrows and notes, saved for you to come back to.Sign in to start drawing