Request scheduler for an LLM inference engine

Reported from the Fellows program. In a provided project, implement the scheduler of an LLM inference engine: the component that decides, step by step, which requests get prefill work (processing the prompt) and which get decode work (generating the next token). The task comes in levels that get progressively harder. Explain the trade-off between prefill and decode work and how your scheduling policy changes from level to level.