Compliance Checklist: 25 Enforceable Boxes Across the Seven Properties

Published

Updated

Twenty-five yes/no checks, grouped by the seven properties: a system either does it or it doesn't. The long form is the 22 auditor questions.

Where the checks come from:

  • Eighteen from the reports. Observed practice in Anthropic's architecture, Brex's governance principles, and Intercom's audit story.
  • Seven from this handbook. The three dependency-provenance items are prescriptions no vendor ships today. Four more harden the audit-trail, review-gate, and reproducibility checks against quieter failure modes.

An item passes only if the system enforces it, not if a policy document promises it. "Engineers are asked not to share tokens" fails the credential items; "the snapshot pipeline aborts when the scrub fails" passes.

1. Attribution: every change traces to a human

Work "needs to be attributed back to an actual human and not just a bot," as Brex states the principle flat (Brex).

No shipping platform fully meets the per-initiating-human bar today. Hold it anyway; it is the standard.

2. Audit trail: the session log is external and queryable

The artifact an auditor reads is the same one that lets a failed agent resume: Anthropic's append-only session log stored outside the containers (Anthropic).

3. Least privilege: credentials never meet model-generated code

4. Isolation and residency: placement is a policy, not a re-architecture

5. Segregation of duties: the author is never the sole approver

Intercom's numbers set the bar for what an enforced gate yields: zero reverts in the 100-PR pilot that proved the gate safe (Intercom).

6. Reproducibility: the change process is encoded

7. Dependency provenance: nothing installs on the model's say-so

These three items are this handbook's prescription, not observed practice; no agent platform ships them today. The gap is real: a USENIX Security 2025 study found 19.7% of packages recommended across 576,000 LLM code samples did not exist, and 43% of hallucinated names recurred on every run (Socket). The cooldown half of the fix is already mainstream in package managers (Nesbitt); the agent platforms haven't adopted it. Full argument: dependency provenance.

Ask for artifacts, not assurances

Three asks separate a vendor (or your own platform team) that produces artifacts from one that offers assurances:

CheckAsk for
Audit trailA live query: "everything actor X did between these two dates," returned from the log, not reconstructed
Credential scrubA scrub-failure log entry showing an aborted snapshot
Segregation of dutiesA recorded attempt at self-approval, blocked by the system

If the answer to any of these is "we could add that," the box is unchecked.

Your score depends on your deployment path

  • Laptops. You fail nearly every box, because the laptop model collapses identity, access, and audit onto one person and one device (why the laptop never had to answer this).
  • Building in-house. Each unchecked box is a project with an owner and a quarter.
  • Buying. This page is the procurement questionnaire; the longer form is the 22 auditor questions.

Everyone, including vendors, fails the last three boxes today. Ask anyway: a vendor that has heard the supply-chain question before is taking it seriously.