← Questions
KL divergence in language models
0
I was asked this
No reports yet. Sign in to say where you were asked it.
Define KL divergence and explain what it measures. Then explain where it is used with large language models and why, for example as a penalty that keeps a fine-tuned model close to its reference model.
No official answer yet. Draw yours on the right; publish it and it shows under Community.
Nothing published yet. Publish your canvas and it shows here for others to open and remix.
Draw your answer hereBoxes, arrows and notes, saved for you to come back to.Sign in to start drawing