Log

A running list of restaurants, cities, films, music, links, work, and whatever else I want to remember.

1 entry · Links

Jun 5 · link

Agent evals and fake precision

Saving this because it explains why agent evals often become fake precision: clean numbers on a benchmark that doesn't resemble the real workflow.

Anthropic (opens in new tab)