System inventory
- You have a written inventory of every AI / agent system in production, including the ones that have crept in via shadow IT.
- Each system has a named business owner, technical owner, and compliance owner.
- Each system is classified against Annex III of the EU AI Act with a defensible rationale (whether high-risk or not).
- For each high-risk system, you have a current intended-purpose statement aligned with Article 13(2).
Logging
- For each high-risk system, logs are generated automatically at the time of action (not reconstructed from disparate sources after).
- Each log entry includes: timestamp, agent identifier, session identifier, action type, action name, resource touched, data classification.
- The logging captures sub-agent invocations and tool calls (not just top-level requests).
- The logging captures decision metadata where the system makes a binary or graded decision: outcome, confidence, reason.
- The logging captures errors, retries, and policy-guard interventions (e.g., denied tool calls).
Data handling
- PII is redacted before the log entry is created, at the source — not in a downstream pipeline.
- You have a hash of the raw input/output so verification is possible without storing the raw data.
- Your sub-processor list explicitly covers any third party that processes log data, even briefly.
- Data residency for the log store is explicit and matches your customer-facing DPA commitments.
Integrity
- Logs are tamper-evident — either hash-chained, Merkle-tree, or signed in a way that makes retroactive editing mathematically detectable.
- The integrity proof can be verified independently by a third party (auditor, regulator) from a read-only copy of the log data, without your assistance.
- Signing keys, if used, are managed under a documented procedure (rotation, custody, audit trail).
Retention
- Retention period is documented per data class, with the legal basis for each retention duration.
- Retention period is at least 6 months for all AI Act-relevant logs (longer where FCA SYSC, MIFID II, or sector-specific obligations apply).
- Cold storage preserves the integrity proof (the hash chain replays correctly from a Parquet archive, for example).
Output
- You can produce a regulator-readable evidence pack for any defined (system, period) pair in less than one working day.
- The pack format has been reviewed by your external auditor or compliance partner for adequacy.
- You have run the production of a pack end-to-end at least once (don't wait for the regulator's first request).
Governance
- You have a written AI governance policy, a named accountable officer, and a documented review cadence (quarterly minimum). The board has reviewed and minuted it within the last twelve months.
Want help running this against your stack? →