← Questions

Speculative decoding for faster generation

0

Implement speculative decoding: a small draft model proposes tokens and the large model verifies them, accepting matching runs to save forward passes. Reported on 1point3acres' Cursor bank; reconstructed in our own words.

Write and test your solution herePython in your browser, the question's tests level by level, saved for you.Sign in to start coding