Constraint is moving from the prompt into the plumbing
An effort budget that moves the outcome more than the model choice, a system prompt cut by four fifths, and a corpus that settles provenance where it is built.
How we organise
A leaderboard for knowledge work rather than code
Ninety-one tasks across four multi-week projects, each producing a real deliverable. Read inside a single model rather than down the ranking. One model reads 1720 Elo at maximum effort and 1470 at medium.
We tell a client that the 250-point range is wider than the gap between that model’s lowest tier and most models below it. The lever a firm controls is how much inference budget a task gets, and it moves the outcome more than the procurement decision everybody argues about. Most firms have a model selection policy. Almost none have an effort budget policy, so the quality of the work is set by whatever default a team left in place.
How we build
New rules of context engineering
More than 80 per cent of a system prompt removed with no measurable loss, and five reversals of advice the industry spent eighteen months codifying. Give the model rules becomes let it use judgement. Front-load the context becomes disclose it progressively.
Our position is that the widest claim is that examples now constrain a capable model rather than assist it. If that holds, every curated few-shot library in a governed platform is a liability. Note what replaces the prose. Control moves into the interface the model acts through, so the constraint stops being something you say.
How we assure
The largest open corpus of source code yet released, drawn from 173 million repositories. Licences are detected file by file, and they propagate through the directory trees rather than stopping at the file. Anything not permissively licensed is excluded.
We read this for the governance rather than the size. Provenance is handled where the corpus is built. If a firm has public repositories it is now demonstrably inside a frontier training set, and what it can prove about its own code supply chain has stopped being hypothetical.