What the record did not reach
Three measurements of things a firm records: what an agent costs once someone has to review it, what a register of tool interfaces can see, and what keeping instructions in a separate channel actually stops.
How we Organise
Two systems a scorecard called identical, and a third more review between them
Sixteen agent systems were qualified against a fixed reliability target on a clinical audit. Two sat 0.3 points apart on accuracy. To reach the same reliability, one had to send 39.2 per cent of its cases to a person and the other 29.6.
We tell clients that the cost of an agent is the whole cost of a good outcome. A buyer reading the first pair of numbers sees two systems that match. The difference is a week of somebody’s time, and that is what a budget carries. It is one clinical audit, so the percentages are not a rate anyone can quote.
How we Build
The part of a tool interface everybody writes down is the part that broke least
A benchmark damaged one stage of tool calling at a time. Damage to the tool interface was the mildest of four families, leaving 0.918 of clean performance. What the tool returns was the worst on every model tested.
Our position is that a team registers every interface a machine consumes: the protocol, the description a model reads, and how many tools a caller chooses between. Every field describes the interface, and what a tool sends back has no field. It was a controlled setting.
How we Assure
Ten ways of asking for the secret were refused, and the eleventh wording got it
An agent refused ten overt instructions to leak a secret. Reworded as an integrity signature or a trusted-looking address, the same request took one model from never leaking to leaking every time. Keeping the hostile page in a separate channel still left 38.8 per cent leaking. Two checks that never read the payload closed it.
We ask a team to keep the model’s instructions apart from what it retrieves, and to run a suite on every change. The overt cases a standard suite carries are the ones every model refused, so it comes back clean while a rewording goes through. This is one synthetic lab. If you read it differently: transform@dromologue.ai.