Sparring
A Two-Point Lead Is Noise Until Proven Otherwise
Coding-agent leaderboards report decimals. The VM, time limit, harness, and leaked answer keys can move the score more than the model.
Tim Cheung5 min read
1 piece
Coding-agent leaderboards report decimals. The VM, time limit, harness, and leaked answer keys can move the score more than the model.
We put frontier models through the same fixed gauntlet: long-context reading, refactors, research, and taste. No vendor decks, no cherry-picked demos.