← Questions
Implement multi-head attention and LLM sampling
0
I was asked this
No reports yet. Sign in to say where you were asked it.
Implement multi-head self-attention from scratch, then the sampling step of a language model: given logits, pick the next token with temperature, top-k and top-p (nucleus) sampling.
No official answer yet. Write yours on the right and run it.
Nothing published yet.
Write and test your solution herePython in your browser, the question's tests level by level, saved for you.Sign in to start coding