An agent’s memory needs a history
Agents fail in familiar ways when they lack context. They don’t know how a company does things, which document is current or why a rule exists.
The usual answer is more memory. In many workflows, though, memory is only useful if it has a history: what the agent believed, where that came from, when it changed and which facts supported each decision.
What a company can own
Competitors can buy the same models. What they can’t buy is a company’s own corrections, rules and outcomes, if those are kept as reusable knowledge with a record of where each came from, who may use it and whether it worked.
A company can own that context and its workflows while renting model access, and switch providers without losing it. That doesn’t mean every company should own the whole stack.
In Theory Ventures’ picture of the harness, the model is the disposable layer and the trace around it is what lasts.[1]
I’d put the company at the center instead. It rents the model, and what its workflows learn stays with it for the next run.
A booking you can explain later
A hypothetical clinic scheduling agent shows what that takes. Answering a question about open slots is easy. Completing the work means identifying the patient, applying the practice’s rules, getting approval, saving the appointment and checking that it saved.
When staff correct it, the correction should improve the next booking rather than disappear into a chat log. If someone later asks why a booking was made, the record should show which rule and which version applied. The W3C’s PROV standard already describes this kind of provenance.[2]
Memory doesn’t grant access
What an agent knows is not what it may do. Access decisions belong in authorization systems built for that job, such as Google’s Zanzibar.[3] Memory can record that access was granted; it shouldn’t grant it.
Where the model runs is a separate choice too. On-device, on-premises, private cloud and disconnected setups trade privacy against cost, upkeep and quality. Running locally isn’t a moat or a security guarantee on its own, and neither is data. Data helps only if it improves an outcome, the company may use it and someone keeps it current.
I’d expect the first buyers to be risk and compliance teams in regulated businesses, since explaining decisions is already their job, though I haven’t tested that. The obvious objection is that agent platforms and systems of record will add versioned memory and audit logs as features. I’d change my mind if compliance teams accept ordinary application logs as enough to explain an agent’s decisions, or if incumbents ship provenance that holds up in a real audit.
Notes:
-
The diagram is credited to Theory Ventures and appears in Tomasz Tunguz, “The Harness Is the New Battleground.” ↩︎
-
W3C, “PROV-Overview: An Overview of the PROV Family of Documents,” 2013. PROV defines provenance as information about the entities, activities and people involved in producing a piece of data. ↩︎
-
Pang et al., “Zanzibar: Google’s Consistent, Global Authorization System,” USENIX ATC 2019. ↩︎