On this page
- 1. Attribution: every change traces to a human
- 2. Audit trail: the session log is external and queryable
- 3. Least privilege: credentials never meet model-generated code
- 4. Isolation and residency: placement is a policy, not a re-architecture
- 5. Segregation of duties: the author is never the sole approver
- 6. Reproducibility: the change process is encoded
- 7. Dependency provenance: nothing installs on the model's say-so
- Ask for artifacts, not assurances
- Your score depends on your deployment path
Compliance Checklist: 25 Enforceable Boxes Across the Seven Properties
Published
Updated
Twenty-five yes/no checks, grouped by the seven properties: a system either does it or it doesn't. The long form is the 22 auditor questions.
Where the checks come from:
- Eighteen from the reports. Observed practice in Anthropic's architecture, Brex's governance principles, and Intercom's audit story.
- Seven from this handbook. The three dependency-provenance items are prescriptions no vendor ships today. Four more harden the audit-trail, review-gate, and reproducibility checks against quieter failure modes.
An item passes only if the system enforces it, not if a policy document promises it. "Engineers are asked not to share tokens" fails the credential items; "the snapshot pipeline aborts when the scrub fails" passes.
1. Attribution: every change traces to a human
Work "needs to be attributed back to an actual human and not just a bot," as Brex states the principle flat (Brex).
No shipping platform fully meets the per-initiating-human bar today. Hold it anyway; it is the standard.
2. Audit trail: the session log is external and queryable
The artifact an auditor reads is the same one that lets a failed agent resume: Anthropic's append-only session log stored outside the containers (Anthropic).
3. Least privilege: credentials never meet model-generated code
4. Isolation and residency: placement is a policy, not a re-architecture
5. Segregation of duties: the author is never the sole approver
Intercom's numbers set the bar for what an enforced gate yields: zero reverts in the 100-PR pilot that proved the gate safe (Intercom).
6. Reproducibility: the change process is encoded
7. Dependency provenance: nothing installs on the model's say-so
These three items are this handbook's prescription, not observed practice; no agent platform ships them today. The gap is real: a USENIX Security 2025 study found 19.7% of packages recommended across 576,000 LLM code samples did not exist, and 43% of hallucinated names recurred on every run (Socket). The cooldown half of the fix is already mainstream in package managers (Nesbitt); the agent platforms haven't adopted it. Full argument: dependency provenance.
Ask for artifacts, not assurances
Three asks separate a vendor (or your own platform team) that produces artifacts from one that offers assurances:
| Check | Ask for |
|---|---|
| Audit trail | A live query: "everything actor X did between these two dates," returned from the log, not reconstructed |
| Credential scrub | A scrub-failure log entry showing an aborted snapshot |
| Segregation of duties | A recorded attempt at self-approval, blocked by the system |
If the answer to any of these is "we could add that," the box is unchecked.
Your score depends on your deployment path
- Laptops. You fail nearly every box, because the laptop model collapses identity, access, and audit onto one person and one device (why the laptop never had to answer this).
- Building in-house. Each unchecked box is a project with an owner and a quarter.
- Buying. This page is the procurement questionnaire; the longer form is the 22 auditor questions.
Everyone, including vendors, fails the last three boxes today. Ask anyway: a vendor that has heard the supply-chain question before is taking it seriously.