Jun 5 · link
Agent evals and fake precision
Saving this because it explains why agent evals often become fake precision: clean numbers on a benchmark that doesn't resemble the real workflow.
A running list of restaurants, cities, films, music, links, work, and whatever else I want to remember.
1 entry · Links
Jun 5 · link
Saving this because it explains why agent evals often become fake precision: clean numbers on a benchmark that doesn't resemble the real workflow.