← AI Feed
AI Feed

The number was right and the thing it stood for was not

AI spend rose twenty-eight times against a budget set once a year, a retrieval score sat on a set that could not tell right code from nearly-right, and a revocation completed while the authority it withdrew was still acting.

How we Organise

The spend moved twenty-eight times and the budget was set once

Across more than 500 organisations, median quarterly AI spend in the tech sector rose nearly twenty-eight times inside a year. Over the same four quarters, the share of developer time going into new features rather than maintenance did not move at all.

Spend that moves that far inside a year is not a variance against a budget, and much of what we argue rests on saying so. An annual budget is not wrong here by a margin somebody tightens next year. It is the wrong instrument. The population is one vendor’s customers.

How we Build

Every leading system found the right code and put the wrong one first

Asked to tell working code from code that nearly works, the best retrieval system returned the right implementation inside ten results every time, and first only a third of the time. What sat at rank one was usually one of that query’s own buggy variants.

We ask a team to sort a bad answer into the material or the reasoning. That depends on a set which can tell right from nearly-right, and a set built the ordinary way lets every system pass. The sorting then clears the material on the word of a set that never had to make the distinction. The variants here were made mechanically rather than found in the wild.

How we Assure

The revocation completed and the earlier work went through anyway

On four widely used providers a completed revocation still left work authorised moments earlier able to reach an effect. In one, every broker had applied the revocation and a request raised before it could still append.

Authority that ends with the task is among the plainer things we say about agents, and here it is false rather than overstated. A team decides it by reading whether the credential was short-lived and whether the revocation completed. Both read true while the work went through. The moment the claim names arrives later than the one anybody reads.