Purpose and accountable data use
Data governance assigns decision authority, handling rules and evidence obligations across an information lifecycle. Privacy governance addresses effects on people; the broader discipline also covers licensed material, confidential business information and operational records.
Purpose limitation constrains collection and subsequent use to specified purposes under applicable rules. Secondary use introduces another purpose.
| Operation and benefit | Information and recipients | Decision authority and boundary |
|---|---|---|
| Read a case to resolve it | Assigned customer’s case; support worker | Service owner: permit only the requester’s authorized case access. |
| Draft a customer reply | Relevant case facts; approved processor and customer | Service owner: exclude internal contact details from customer-facing context. |
| Change customer contact details | Proposed values; authoritative record service | Record owner: require separate write authorization. |
| Train a reusable model | Conversation examples; training operator | Accountable purpose owner: require a separate assessment before reuse. |
| Evaluate support employees | Staff-linked conversations; management | Exclude from case-resolution approval; assess consequences separately. |
Necessity connects each field to a benefit. Proportionality weighs that benefit against effects on people and less intrusive alternatives. A decision can narrow the task or refuse it rather than approve every technically possible use.
- Protection does not grant permission — Accurate, encrypted documents can still carry a license that excludes the intended reuse. AI Security addresses protection; permission requires its own assessment.
- Permission does not establish fitness — Authorized conversation examples can contain incorrect model-generated answers. Data Quality and Curation addresses whether those records are suitable for training.
Information inventories across processing boundaries
Under the EU GDPR, personal data relates to an identified or identifiable person—the data subject. Identification can be indirect.
The inventory must include inferred attributes, not just submitted fields. Ordinary writing can support predictions about someone’s location or circumstances, creating sensitive information without an explicit identifier.
One case, several governed artifacts
ExampleBranches create separate handling obligations.
Read the diagram as text
- Case record.
- Retrieval index.
- Model input.
- Provider inference. External organization.
- Generated reply.
- Response cache.
- Audit events.
- Training examples.
- Case record → Retrieval index: Derive representations.
- Retrieval index → Model input: Select context.
- Model input → Provider inference: Approved external disclosure.
- Provider inference → Generated reply: Return generation.
- Generated reply → Response cache: Retain response.
- Model input → Audit events: Record selected metadata.
- Model input → Training examples: If reuse approved: input.
- Generated reply → Training examples: If reuse approved: target.
- Sources and derived profiles — Inventory case records, uploads and summaries separately. A profile derived from purchases is a new interpretation of those records, not the original observations.
- Retrieval representations — Embeddings are numerical representations used for tasks such as similarity search. Inventory them alongside their source text; numerical representation does not establish concealment.
- Model interactions and learning — Inference applies fitted model behavior; training changes fitted state using examples. Prompts, outputs and feedback may later become training records, introducing another use. Machine Learning Fundamentals explains the distinction.
- Operational copies — Telemetry records system behavior and can contain sensitive attributes. Persistent checkpoints and application stores create further copies with lifetimes independent of a model request.
For each artifact, record its owner, purpose, location, recipients and downstream copies. Inventory relationships as well as storage systems: a protected source can feed a differently governed destination.
Rights, restrictions and decision authority
A lawful basis is an applicable legal ground for processing personal data; consent is not universally required.
Public availability does not settle that assessment. Under the EDPB’s AI-model opinion, reliance on legitimate interests requires an interest, necessity and balancing against affected people’s rights. Development and deployment can have different purposes.
| Role or authority | Meaning | Boundary |
|---|---|---|
| Data controller | Under EU guidance, determines purposes and essential means. | Actual activities determine the role; ordinarily an organization, not its employee. |
| Data processor | A separate entity processing on the controller’s behalf. | A contractual label cannot override actual activities. |
| Internal steward or system owner | Maintains agreed definitions, ownership and operating responsibilities. | An internal assignment does not determine the organization’s legal processing role. |
| Access implementer | Configures credentials and resource permissions. | Technical capability does not authorize every use. |
Copyright is an independent restriction. The US Copyright Office’s May 2025 report explains that downloading and preparing training material can implicate reproduction rights. Licensing may authorize specified uses; fair use depends on circumstances. The report is institutional analysis, not a binding judgment granting permission for a particular corpus.
Under the EU trade-secrets directive, a trade secret must be secret, commercially valuable because of secrecy, and reasonably protected. Unauthorized copying, disclosure or use contrary to confidentiality duties can be unlawful. Statutory exceptions apply, including specified public-interest disclosures. Other confidential information may remain contractually restricted without satisfying that definition. Internal approval cannot override applicable restrictions.
Qualified review needs a concrete processing description.
- Review record — Name purposes, relevant jurisdictions, affected people, data categories, rights holders, operators and intended recipients; assign responsibility for unresolved restrictions.
Transparency, consent and individual requests
A privacy notice explains handling; access rights concern data and handling information. Under GDPR, additional identity evidence must be necessary to resolve reasonable doubts, not routinely demanded.
When relying on consent, retain the purpose, scope, notice version, when and how agreement was obtained, and withdrawal history. The EDPB consent guidelines require demonstrable validity; a checkbox alone is insufficient. Choice must be meaningful, and withdrawal must be as easy as consent without detriment.
| Request | Operational consequence |
|---|---|
| Access | Provide the applicable data and handling information, respecting others’ rights. |
| Rectification | Investigate disputed accuracy and explain the outcome. |
| Erasure | Address live copies and backups when the request is valid and no exemption applies. |
| Restriction | Qualifying cases limit processing; storage may continue. |
| Objection | Conditions depend on the purpose; direct-marketing use must stop. |
Withdrawal does not retrospectively invalidate previously lawful processing. Another independently established purpose may continue under its own ground; an organization cannot invent a replacement ground to evade withdrawal. Route the change by purpose, identify affected processing, and retain evidence of what stopped.
For an inferred customer attribute, determine what the record asserts. The ICO’s rectification guidance distinguishes factual errors from clearly recorded opinions. Assess the person’s evidence and consequences of use, restrict processing while checking where appropriate, and explain decisions and challenge routes. Calling every prediction an opinion does not resolve accuracy duties.
- Accountable handling — Assign an owner who can investigate, authorize correction and communicate the disposition. Context matters: clinical documentation and professional review involve responsibilities that cannot be replaced by a universal consent rule.
Minimization and remaining identification risk
Minimization limits collection, use, exposure and duration to the approved purpose. Omission prevents a copy from being created; later filtering must locate and transform information already present.
| Reduction | Retained utility | Remaining limitation |
|---|---|---|
| Select one authorized case | Case-specific assistance | Other fields within that case can remain sensitive. |
| Omit employee contact fields | Customer-facing status explanation | Free text can still disclose personal details. |
| Aggregate operational counts | Workload monitoring | Loses case detail; aggregation alone does not establish anonymity. |
| Replace names with stable substitutes | Link related records | The preserved association can still identify someone. |
Redaction removes or masks sensitive content. Detection can return sensitive spans and categories separately from replacement policy, allowing removal, category labels or stable substitutes without conflating extraction with privacy validation.
Pseudonymization separates identifying information under safeguards while retaining possible association. Anonymity requires evidence about identifiability in context, not merely transformed appearance.
- Linkage — The Netflix-history research showed that auxiliary knowledge of a few ratings and approximate dates could link released records to people, exposing additional ratings. Removing names did not remove distinctive combinations.
- Reconstruction — Embedding reconstruction research recovered text, including names in clinical examples, under tested encoder-access conditions. This establishes a concrete risk, not a recovery rate for arbitrary indexes.
- Inference — A study illustrates inferring Melbourne from commuting language describing a characteristic turning maneuver. The mechanism uses contextual clues, not an explicit address. Such inference creates a claim about someone; it does not establish that the claim is correct.
Hashing predictable identifiers permits candidate guessing. Apply purpose-driven capture before export, as explained in Observability; collecting fewer records does not make retained content harmless.
Generated derivatives require their own anonymity assessment. Local execution changes who operates infrastructure, but leaves the application responsible for classification, permissions and appropriate use.
Authorization at access and disclosure boundaries
Authentication establishes identity; authorization determines permitted operations on particular resources. A service account’s credentials may reach more records than the requesting person is entitled to use.
Role-based rules assign permissions through roles. Attribute-based access control evaluates requester, resource, operation and environmental characteristics. An application can express tenant, purpose and recipient constraints through such attributes; their values must be trustworthy and current.
Access and disclosure need separate gates
ExamplePermitted retrieval can still produce a prohibited disclosure.
Read the diagram as text
- Requester and purpose.
- Access gate.
- Retrieve and draft.
- Recipient gate.
- Authorized recipient.
- Stop without disclosure.
- Requester and purpose → Access gate: Control: current authority.
- Access gate → Retrieve and draft: Control: access permitted.
- Access gate → Stop without disclosure: Control: denied or unknown.
- Retrieve and draft → Recipient gate: Data: proposed response.
- Recipient gate → Authorized recipient: Data: disclosure permitted.
- Recipient gate → Stop without disclosure: Control: denied or unknown.
- Narrow retrieval — Separate indexes can restrict candidate documents by audience or version. Selection is useful, but choosing an index does not establish complete authorization. Search and Retrieval covers candidate-selection mechanics.
- Preserve delegation context — A multi-service action must carry the original user’s authorization context. A verifiable delegation token can support attribution, but its existence alone does not establish revocation handling or appropriately narrowed privileges.
Least privilege grants only necessary authority. Complete mediation checks every protected access, including cache reads, exports, tool calls and recovery paths. Cached decisions must account for revocation. When required authority cannot be established, deny the operation. AI Security explains enforcement against attacks; model willingness is never the authorization boundary.
Approval and authoritative record changes
A system of record is the designated authoritative source for a business fact. A data contract records the producer–consumer agreement around that information. Integration into existing work explains why field meanings, identifiers, ownership and support responsibilities matter.
Permission to summarize a customer conversation does not include permission to update contact details. Read, edit, delete and copy are distinct operations.
Approval survives as history, not permission
ExampleChanged record state defeats the reviewed precondition.
C1 targets v1.
Read the diagram as text
- Contact change C1.
- Proposed against v1.
- Approved against v1. Historical approval.
- Current record v2.
- Commit rejected.
- Contact change C1 → Proposed against v1: Proposal.
- Proposed against v1 → Approved against v1: Reviewer authorizes.
- Approved against v1 → Commit rejected: Precondition no longer holds.
- Current record v2 → Commit rejected: Version mismatch.
- Proposal. C1 targets v1. Active: Contact change C1, Proposed against v1. New: Contact change C1, Proposed against v1.
- Approval. Review binds to v1. Active: Contact change C1, Proposed against v1, Approved against v1. New: Approved against v1.
- Rejection. v2 prevents commitment. Active: Contact change C1, Proposed against v1, Approved against v1, Current record v2, Commit rejected. New: Current record v2, Commit rejected.
- Bind consequential approval — Where independent approval is required, enforce both authorities at the protected write. Bind approval to the specific proposal; separate credentials alone do not establish separation of duties.
- Do not expand scope silently — If execution discovers a missing permission, request additional authorization or stop that operation. Dynamic scope negotiation is a mechanism for obtaining authority, not permission to invent it.
An HTTP update carrying If-Match: "v1" must not execute when the current strong entity tag differs. This prevents stale writes, not unauthorized or factually incorrect ones.
Keep an AI-inferred attribute distinguishable from a confirmed fact. Correction requires an accountable disposition and a new authorized update; a historical error can remain accurately recorded alongside its correction.
Lineage and proportionate audit evidence
Provenance describes origin and history; lineage records derivation relationships. W3C PROV distinguishes information entities, transforming activities and responsible actors. Participation in one activity does not itself establish derivation.
Dataset versions locate a collection; record-level relationships identify particular contributors. Retrieval-use graphs can reveal which chunks appeared in conversations, but frequent use establishes neither correctness nor permission. Citation links also require preserving the backend path to source facts.
Derivation differs from responsibility
ExampleCorrection follows contributing artifacts, not shared ownership alone.
Read the diagram as text
- Source S1 v1.
- Summarize.
- Summary M1.
- Build retrieval representation.
- Index entry I1.
- Draft reply.
- Reply R1.
- Responsible owner.
- Source S1 v1 → Summarize: Used.
- Summarize → Summary M1: Generated.
- Source S1 v1 → Build retrieval representation: Used.
- Build retrieval representation → Index entry I1: Generated.
- Summary M1 → Draft reply: Context.
- Index entry I1 → Draft reply: Retrieval contribution.
- Draft reply → Reply R1: Generated.
- Responsible owner → Summarize: Responsible for.
| Evidence | Investigation purpose |
|---|---|
| Source and output identifiers; versions; transformation | Locate the information used and produced. |
| Purpose, policy version, requester, approver, recipient and outcome | Reconstruct the authorization and resulting action. |
| Restricted payload reference | Permit investigation without duplicating content into ordinary developer logs. |
Separating orchestration events from versioned sensitive objects lets developers inspect execution without receiving payload access. References and metadata still need privacy review. An immutable event log preserves recorded history; it cannot supply events that were never captured.
Restrict and review audit access, protect integrity, sanitize untrusted event fields, and apply disposal rules to extracts and backups. Avoid copying credentials or sensitive payloads for convenience. Capture policy governs which diagnostic information is emitted.
- Centralize consistent attribution — Uber’s described Model Gateway combines request attribution, policy middleware and audit-session capture. Such a shared boundary can standardize records; the example does not specify stored-trace retention or complete downstream coverage.
Vendor and model-processing obligations
A data processing agreement documents processing obligations. Under EU controller–processor guidance, a subprocessor is another processor engaged in the chain. Authorization, change notification, audit information and return-or-delete arrangements require explicit handling. Contract terms do not establish fulfillment.
No-training commitments and no-retention commitments answer different questions. Anthropic’s feature-specific retention documentation, checked August 29, 2026, distinguishes storage-dependent features from zero-retention eligibility. It separately describes training permission and hosting relationships. Those distinctions must be checked for the actual product and configuration.
| Review dimension | Required distinction |
|---|---|
| Training and feature storage | Document permitted reuse separately from storage required by enabled features. |
| Monitoring and support access | Identify processing purpose, authorized people and retained information. |
| Configuration and evidence | Check the selected feature and route; general provider statements do not prove account settings. |
| Exit | Within the EU relationship, return or delete as directed; address copies and applicable storage exceptions. |
Data residency concerns where information resides; cross-border transfer concerns movement or access across national boundaries. A VPC—an isolated cloud network—does not establish government-cloud or on-premises availability. The managed-RAG deployment discussion illustrates that distinction, not current vendor suitability.
Self-hosting transfers more software, patching and availability work to the operator. Managed services transfer some infrastructure work to providers. Neither arrangement transfers the application’s responsibility for data classification, permissions and appropriate use; location alone cannot settle those obligations.
Retention schedules and restricted preservation
Retention is how long information remains stored or available. A cutoff starts a retention period; disposition is eventual destruction or transfer. NARA’s scheduling guidance provides a useful event-based model, not disposal authority for private applications.
| Artifact class | Possible triggering event |
|---|---|
| Source cases and uploaded documents | Case closure |
| Prompts, outputs and feedback | Approved operational purpose ends |
| Indexes and caches | Source eligibility ends; derived cleanup verified |
| Telemetry and audit extracts | Investigation or operational retention trigger |
| Training datasets and models | Approved learning or deployment use ends |
| Backups | Replacement cycle, subject to applicable restrictions |
A legal hold is a preservation obligation requiring qualified interpretation. Document its basis, covered records, owner, access restrictions and release conditions. An exception permitting preservation does not automatically permit continued ordinary processing.
For valid erasure requests, UK guidance addresses backups as well as live systems. Copies awaiting scheduled overwrite must remain beyond use, not repurposed. Explain that status to the person; ending active access is different from completed destruction.
Lifecycle fulfillment across derivatives
Stopping a purpose, revoking authority, correcting a fact and deleting a copy are distinct operations. Keep a destination ledger so successful work at one store cannot conceal unfinished work elsewhere.
| Destination | Completion evidence |
|---|---|
| Source and derived records | Accepted correction and its downstream disposition |
| Indexes, caches and exports | Removed content is unavailable through each affected serving path |
| Vendor copies | Destination-specific fulfillment evidence, not just a submitted request |
| Evaluation and training examples | Affected versions identified and reuse stopped or changed |
| Backups and restoration | Applicable restriction remains effective when restoration is tested |
Keep the marker until removal is verified
ExampleSource deletion and search invisibility are separate facts.
Both copies remain available.
Read the diagram as text
- Source S1.
- Index entry I1.
- S1 live.
- I1 searchable.
- S1 soft-deleted; marker retained.
- I1 removal verified.
- S1 purged.
- Source S1 → S1 live: State.
- Source S1 → S1 soft-deleted; marker retained: State.
- Source S1 → S1 purged: State.
- Index entry I1 → I1 searchable: State.
- Index entry I1 → I1 removal verified: State.
- Available. Both copies remain available. Active: Source S1, Index entry I1, S1 live, I1 searchable. New: Source S1, Index entry I1, S1 live, I1 searchable.
- Mark. I1 remains searchable. Active: Source S1, Index entry I1, S1 soft-deleted; marker retained, I1 searchable. New: S1 soft-deleted; marker retained.
- Process and verify. Indexer processes the marker; query checks removal. Active: Source S1, Index entry I1, S1 soft-deleted; marker retained, I1 removal verified. New: I1 removal verified.
- Purge. Remove S1 after downstream verification. Active: Source S1, Index entry I1, S1 purged, I1 removal verified. New: S1 purged.
Azure’s blob deletion policy needs an observable marker and sufficient retention for indexer outages. Its soft-delete policies exclude one-to-many indexing; those derived entries require explicit deletion.
Deletion acknowledgement and search visibility can differ. Elasticsearch exposes a refresh boundary; deleted-version retention is also finite. Delayed ingestion therefore needs durable deletion markers or version checks beyond that window to prevent obsolete records from returning.
- Retry without recreating data — A deletion ledger must preserve outstanding destinations across failures. Retry contracts need stable operation identity and defined retention; merely logging an identifier does not make a receiving API idempotent.
- Separate model influence — Machine unlearning attempts to remove selected training influence. A verification study on image classifiers showed that dishonest providers could pass the studied checks while retaining information. Stored-record deletion therefore requires different evidence from claims about learned behavior.
Deleting a stored artifact cannot retract an earlier disclosure. Report verified destinations, restricted exceptions and unresolved effects separately; the accountable owner decides the remaining response rather than declaring universal completion.
Assurance and operating changes
A privacy impact assessment examines processing, effects on people, alternatives, mitigations and residual risk—the risk remaining after controls. A DPIA is a jurisdiction-specific data protection impact assessment; the ICO guidance distinguishes legal triggers from wider good practice and calls for reassessment when processing changes.
| Boundary | Focused verification |
|---|---|
| Retrieval and recipient | Attempt unauthorized retrieval and a recipient change; inspect actual disclosure. |
| Withdrawal | Confirm the withdrawn purpose stops across affected processing. |
| Record changes | Check rejected stale proposals and authorized correction outcomes. |
| Deletion | Test cache, export and restoration paths independently. |
| Vendor changes | Review changed processing conditions before extending operation. |
Changing product context changes the decision. Workday’s described progression from help articles to page-aware assistance introduced compensation information with greater sensitivity. Reusing an assistant interface did not preserve the original data-risk boundary.
When a boundary fails, contain affected processing, preserve necessary restricted evidence, investigate scope and correct the cause. Resume only the paths whose restoration criteria have been verified with their owners. Passing fresh-request checks cannot justify an untested cache or restore path. AI Security covers the broader response discipline.
Open questions
Derivative anonymity remains difficult to establish across changing access conditions. Embedding reconstruction and contextual attribute inference expose different risks; progress requires evaluations covering the actual encoder, accessible representations and plausible auxiliary information, rather than treating a transformation label as evidence.
Disputed AI attributes need context-sensitive correction rules. The boundary between factual assertion and recorded opinion changes the response, while either can affect a person. Progress would include documented dispositions tied to what each record asserts and the consequences of its use.
Deletion remains vulnerable to delayed replay. Finite search-engine deletion history can outlive neither every queue nor every restoration source. Progress requires demonstrated rejection of obsolete updates after ordinary deletion metadata expires, with explicit coverage of restoration paths.
Verifying removal of training influence remains an assurance problem distinct from deleting examples. The studied verification methods can be fooled by dishonest providers; extending trustworthy checks to deployed language models requires evidence beyond the image-classification settings already tested.










