← Questions
Batching service around an embedding model
0
I was asked this
No reports yet. Sign in to say where you were asked it.
Put a service around an embedding model: many callers send texts at once, the service groups them into batches for the model, returns each caller its vectors, and stops without losing work. A variant limits every batch both by number of texts and by total tokens.
No official answer yet. Write yours on the right and run it.
Nothing published yet.
Sign in to submit your code; every attempt is kept here.
Write and test your solution herePython in your browser, the question's tests level by level, every submission kept for you.Sign in to start coding