← Questions
Stable softmax and multi-head attention in NumPy
0
I was asked this
No reports yet. Sign in to say where you were asked it.
In NumPy, implement a numerically stable sigmoid and softmax, then scaled dot-product attention, then multi-head attention from scratch.
No official answer yet. Write yours on the right and run it.
Nothing published yet.
Sign in to submit your code; every attempt is kept here.
Write and test your solution herePython in your browser, the question's tests level by level, every submission kept for you.Sign in to start coding