← Questions
Implement a decoder-only GPT model
0
I was asked this
No reports yet. Sign in to say where you were asked it.
Write a small decoder-only transformer from scratch as four classes: multi-head self-attention with a causal mask, the feed-forward block, a decoder layer that combines them with residual connections and layer norm, and the GPT model that adds token and position embeddings, stacks the layers and projects to vocabulary logits.
No official answer yet. Write yours on the right and run it.
Nothing published yet.
Sign in to submit your code; every attempt is kept here.
Write and test your solution herePython in your browser, the question's tests level by level, every submission kept for you.Sign in to start coding