← Questions

Build an eval harness for local models served by Ollama

0
MercorAI systemLast asked Mar 2026

A take-home of about four hours (AI coding tools allowed): write an evaluation harness that runs a set of test cases against language models served locally through Ollama, scores the outputs and reports the results.

Your canvas
Draw your answer hereBoxes, arrows and notes, saved for you to come back to.Sign in to start drawing