← Questions
CLIP contrastive loss
0
I was asked this
No reports yet. Sign in to say where you were asked it.
Implement the CLIP-style contrastive loss for a batch of matching image and text embeddings.
Build the image-text similarity matrix, take the cross-entropy against the diagonal (each image's match is its own text) in both directions, images to texts and texts to images, and average the two. Discuss normalizing the embeddings and the temperature.
No official answer yet. Draw yours on the right; publish it and it shows under Community.
Nothing published yet. Publish your canvas and it shows here for others to open and remix.
Draw your answer hereBoxes, arrows and notes, saved for you to come back to.Sign in to start drawing
