Design a distributed task scheduler with dependencies

Design a system that runs jobs made of tasks with dependencies between them, including long-running tasks. Cover how jobs and their dependency graphs are stored, how ready tasks are found and dispatched to workers, retries and timeouts, worker failures, and how users see progress.