← Questions
Debug a model that does worse online than offline
0
I was asked this
No reports yet. Sign in to say where you were asked it.
A model scored well in offline evaluation, but after launch its online metrics are worse. How do you find out why? Walk through the likely causes (training-serving skew in features, data drift, leakage in the offline set, a mismatch between offline and online metrics, feedback loops), how you would check each one, and what you would change so it does not happen again.
No official answer yet. Draw yours on the right; publish it and it shows under Community.
Nothing published yet. Publish your canvas and it shows here for others to open and remix.
Draw your answer hereBoxes, arrows and notes, saved for you to come back to.Sign in to start drawing
