A manifesto by Vouchstone
Why most enterprise AI agents never ship.
88% of enterprise AI agent pilots never reach production. Not because the models got worse — they got dramatically better. They fail for three reasons, cited by the teams building them: evaluation gaps, governance friction, and model-reliability concerns. Not one of those is a model problem. All three are proof problems.
An agent walks into security review having done something real — read a document, proposed an approval, taken an action. Security asks a simple question: what data did it actually see? There's no good answer. Compliance asks how you'd audit that decision six months from now. There's no structured record. IT asks if it was tested. There's a demo, not an evaluation. Nobody in the room is arguing the model is dumb. They're arguing nobody can prove what it knew.
That's the actual gap between a working demo and a production system: not capability, accountability. A pilot that works in a demo and a system that survives an audit are different engineering problems, and almost nobody is building for the second one.
Grounding is not optional
An agent that reasons over unstructured context can't tell you, precisely, what it knew when it acted. An agent grounded in a knowledge graph built from your own systems can. Vector search is how you find candidate facts — necessary, but not sufficient for an audit trail. Once a fact is confirmed, it becomes a deterministic graph fact: fixed, queryable, citable. Hybrid discovery, deterministic decision. That distinction is the whole difference between an agent that sounds right and one that can prove it was right.
One model's guess is not verification
A single LLM call, however capable, is still one perspective on a business question that deserves scrutiny. Verification means a genuine second look — a council, not a confidence score — cross-checking the answer against the same grounded facts before it ships. Evaluation gaps, the single most-cited cause of pilot failure, get closed by actually testing the system before it acts, not by trusting that it probably will.
Every decision has to survive being asked about later
Governance friction isn't a compliance team being difficult — it's a compliance team correctly refusing to sign off on something they can't reconstruct. Every action an agent takes should pass a real check — policy, role, budget — and leave behind a signed, replayable record. Not a log line. An answer to “why did this happen”, six months later, that doesn't require asking the model to remember.
Somebody has to own it after launch
A pilot with no named owner dies quietly the moment its champion changes teams. A system your own engineers can inspect, customize, and run inside your own network — against the same graph, through the same verification — is one your organization can actually keep. Ownership isn't a nice-to-have bolted on at the end. It's what makes everything before it durable.
None of this makes agents smarter. It makes them provable — which turns out to be the actual thing standing between a good demo and a system your business can trust with something that matters.