Adam, AdamW and decoupled weight decayML designWrite Adam's update: the first and second moment estimates, bias correction and the step. Why is adding an L2 penalty to the loss not the same as weight decay once Adam's…
Last asked Sep 2026
#training
Design a platform to train and serve ML modelsML designDesign a platform that lets teams train machine learning models and serve them in production. Cover data access, training jobs, storing and versioning models, deployment, and…Last asked Aug 2026
Audio preprocessing and model training choicesML designCompare ways to preprocess audio for a model (raw waveform, spectrograms, mel features, normalization, augmentation) and their pros and cons, then walk through the steps of…Last asked Feb 2026
Design a video vision-language model end to endML designDesign a model that understands video and answers questions about it in language: data and its labels, frame sampling and the video encoder, how visual tokens reach the language…Last asked Feb 2026
Write a 2-D convolution, a biased attention step and a training loopCodingImplement small ML building blocks from scratch: a 2-D convolution in NumPy, an attention step with an added bias term before the softmax, and the missing pieces of a standard…Last asked Dec 2025