The Agent Works. Does Anyone Trust It? — Michele Grant, Leading at Scale
Read the talk
The Agent Works. Does Anyone Trust It?
Michele Grant’s acquisition-integration example shows how measurable value, named decision owners and inspectable engineering evidence let an organization grant—and withdraw—an agent’s authority.
From a talk by Michele Grant
At a glance
Ideas worth remembering
Baseline report duration, capacity actually redeployed and detection time separately. Faster reporting alone does not establish earlier intervention or net business value.
Assign both executive accountability and daily intervention authority. Each consequential decision needs a human owner, required evidence and an escalation path.
Run financial calculations in deterministic, approved code. Preserve input records, tool execution, versions and sign-off; escalate ledger discrepancies without changing the number.
Greater autonomy requires checking what the agent failed to flag. Independent sampling helps distinguish better performance from weaker review, and supports holding or reducing authority as well as promotion.
Go-live does not establish trust
A system can go live without anyone relying on it or realizing a dollar of the value used to justify it. Michele Grant, creator of Leading at Scale, opens with that gap. Her experience in enterprise transformation and acquisition integration makes trust an operating problem: teams need change management and risk management before launch so they can actually use the system afterward.
For an agent, trust requires delivering the value the business budgeted for while remaining within its approved risk appetite, policies and regulatory guardrails. Three questions organize the work: What value does it create? Who is accountable? What evidence permits greater autonomy? A successful pilot answers whether the software functions. A core business workflow adds the question of whether it produces value under leadership’s controls.
Risk principles still need agent-specific decisions. Leadership must specify permitted actions, ownership, recorded evidence and escalation triggers. Engineers implement much of this behavior, but deciding how much authority the business will delegate is an executive operating responsibility.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
A matching report leaves the business question open
The running example is an illustrative $15 billion acquisition targeting $400 million in net synergies. After the deal closes, the integration management office, or IMO, coordinates 40 workstreams, from rationalizing vendor contracts to consolidating ERP systems. Each initiative has a business owner accountable for its savings. These figures frame the scenario; they are not disclosed deployment results.
Every week, IMO analysts collect updates from the 40 leads, reconcile numbers against the general ledger, compare actuals with the plan and assemble an executive deck. The audience is a steering committee containing the CFO, chief risk officer, business unit heads and integration lead. The report connects operational progress to the people who can intervene.
An agent automates the first draft: it ingests weekly updates, reconciles the ledger, calculates variances against the plan and flags initiatives falling behind. During a four-week pilot, its drafts match the analysts’ reports line for line. That establishes the scenario’s technical success. It leaves the steering committee with a separate decision: what additional evidence would justify relying on this agent to help run the integration?
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Measure faster reporting, usable capacity and earlier detection separately
Before the agent touches production data, the steering committee needs an agreed written value case. Grant separates three measures because a faster report does not necessarily release useful capacity or reveal trouble sooner.
- Reporting cycle time. If compiling the weekly report currently takes five business days, set a concrete target such as two days. This measures how quickly the reporting process finishes.
- Analyst capacity redeployed. Four analysts spending half their week on the deck represents 80 hours a week of potentially released capacity. It becomes value when the integration lead assigns that time to workstreams missing their synergy targets. The value case must also subtract compute, licensing and human review costs.
- Detection time. Measure the interval between the first sign of a slip in the data and the steering committee seeing it. Finishing the deck in two days cannot help if the agent misses the slip.
The causal distinction matters. Shortening report preparation changes a process duration. Reassigning analysts changes where the organization spends its effort. Detecting a material issue earlier changes when leadership can act. Each needs its own pre-deployment baseline; otherwise, a successful-looking report cannot establish which business outcome improved. Grant’s deployment rule is firm: if the IMO cannot state the baseline, do not deploy.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Separate operating ownership, oversight and assurance
The next question is who owns the risk. Grant applies the three lines model, separating the people responsible for running the workflow from those challenging its controls and those providing independent assurance.
- Management owns the controls. The integration lead remains the accountable executive and owns the agent’s output just as she owned the manual deck.
- Risk and compliance oversee and challenge. Their review should reflect the agent’s exposure. An internal draft checked by a senior analyst warrants a different standard from an autonomous system publishing figures directly to the board.
- Internal audit provides assurance. Material risk determines when and how the agent enters the annual audit plan.
Executive accountability also needs a daily operator. Here, the senior analyst reviews the draft before the committee receives it. That employee must understand the agent’s operational limits, interpret its output in context, have authority to override or reverse it and have a clear kill switch for unexpected behavior. Assigning a reviewer without the power to intervene would leave the role incomplete.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Give each consequential decision a human owner
A one-page human work standard records where the agent’s authority stops. At each fork in the process, it names the decision, the human role authorized to make it, the evidence required and the escalation path. The acquisition example makes those assignments concrete.
- Interpret the variance. The senior analyst decides whether a difference reflects accounting timing or a real cash shortfall.
- Choose the remedy. The workstream lead decides how to address a shortfall.
- Declare the initiative at risk. The integration lead decides whether to formally raise its status to the steering committee.
The agent prepares analysis for all three decisions; the people making them own the consequences. Keeping those judgments with their existing owners lets the agent enter use without acquiring their authority. An unassigned decision creates a different problem: if nobody owns declaring an initiative off track, the agent can produce correct flags that lead to no action. A missing owner is a reason to delay deployment.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Keep financial proof in code, telemetry and sign-off
Greater autonomy needs evidence built into the system. The first artifact is an auditable decision log. For each workstream evaluated, it records the raw input data, executed tool calls, prompt and model versions, generated output and human sign-off. Together, these records let a reviewer inspect what the agent used, what it did and who accepted the result.
Two engineering decisions give that log substance. Core financial calculations and reconciliation rules run in deterministic, finance-approved code. The language model’s written summary explains the result; it does not establish that the calculation was correct. The supporting evidence is which records were retrieved, which deterministic tools ran and who signed the review.
A disagreement between reported savings and the general ledger shows how this division affects behavior. The agent leaves the number untouched, flags the discrepancy and escalates it. Generating a plausible explanation must not become permission to alter the financial figure.
The second artifact is a model inventory record containing the accountable executive, data lineage, source-system dependencies, validation results, escalation paths and kill switch runbook. It also documents regression triggers: changes to a prompt, base model or source API require full revalidation before production use resumes. Validation therefore attaches to a particular configuration and its dependencies, rather than granting permanent approval to the agent’s name.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Reduce routine review without losing sight of missed issues
The third artifact, an autonomy scorecard, lets the steering committee grant authority in four stages. Shadow mode keeps the existing analyst-built report while the agent runs alongside it for comparison. In the supervised-draft stage, the agent prepares the report and the senior analyst reviews every line item.
What changes as review narrows? The comparison below separates routine review from the checks on work the agent considers clean. At stage three, the analyst reviews flagged initiatives plus a random sample of clean ones. At stage four, routine review covers only high-risk anomalies, while periodic independent sampling continues. “Exceptions only” describes the analyst’s routine workload; independent checking still has a job.
The danger at stage four is a material problem the agent never flags. Reviewing only the flagged set cannot reveal those omissions. Independent sampling examines work outside that set, helping track missed material issues and their severity. It also helps interpret a falling override rate: fewer overrides may reflect better output, or they may reflect shallower human review.
The scorecard puts these control measures beside reporting cycle time, analyst hours redeployed and detection time. This gives the committee a basis to promote the agent, hold its current authority or step it back to supervised review. Grant supplies the review structure, rather than numeric promotion thresholds or a sampling schedule; those decisions still need to be made for the workflow’s risks.
What humans inspect at each autonomy stage
Read the diagram as text
- 1. Shadow mode. Human review coverage — The analyst builds the existing report. The agent runs alongside it, and the team compares the reports.
- 2. Supervised draft. Human review coverage — The agent compiles the draft. The senior analyst reviews every line item.
- 3. Exceptions and sample. Human review coverage — The analyst reviews flagged initiatives and a random sample of clean initiatives.
- 4. Exceptions only. Human review coverage — Routine review covers high-risk anomalies. Periodic independent sampling checks for missed material issues.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Earlier evidence gives operating leaders time to act
The ending returns to who actually captures the acquisition’s $400 million in targeted synergies. Procurement, supply chain and operating leaders do that work through integration. The agent’s contribution is to give them verified evidence early enough to intervene while savings remain achievable. Grant describes that benefit as evidence arriving weeks ahead of schedule—a prospective benefit of the scenario, rather than a measured outcome of the four-week pilot.
That connects the three questions to a business decision. The value case defines what improvement counts. Named owners turn analysis into action. Logs, validation and sampling let leadership decide how much review the agent still needs. A working agent earns trust at scale when the organization can make those decisions with evidence—and reduce its authority when that evidence changes.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Read the complete timestamped transcript
- 0:02
Go-live proves that a system exists, but it doesn't prove the people behind the work will actually use it, or that it will ever deliver a single dollar from the deal model. I am Michele Grant, creator of Leading at Scale, and the question every enterprise is confronting right now is: Agent works, does anyone trust it? I have spent over twenty years in enterprise transformation and more than a decade
- 0:32
leading M&A integrations across media, tech, and consumer goods. On those deals, trust was not something we crossed our fingers and hoped for after launch. We engineered it before day one through early change management and risk management. So when the platform went live, the teams on the ground actually relied on it.
- 1:03
AI agents demand the exact same muscle. An agent earns trust when it delivers the value the business budgeted for while staying strictly within the company's approved risk appetite, policies, and regulatory guardrails. In my experience, leadership gets there by answering three straightforward questions: What value does it create?
- 1:32
Who is on the hook for it? And what evidence gives it permission to run with greater autonomy? The moment an agent steps out of a sandbox and into a core business workflow, the entire test changes. A pilot tests whether the software functions, but daily operations is where we test whether it creates value within the controls set by leadership.
- 2:02
Established AI risk frameworks give you strong principles. What they do not give you is how to apply these principles to each agent. For every agent, leadership has to decide four things: What is it permitted to do? Who owns it? What evidence it records, and what triggers an escalation? That work is not an engineering task. We find it is an
- 2:31
executive operating mandate, and today I'll show you how to meet it. Let us ground this in a real-world scenario. Picture a fifteen billion dollar acquisition targeting four hundred million in net synergies. The deal has already closed, and the integration efforts are now underway. The integration management office, which we'll also refer to as the IMO
- 3:01
today, is driving the synergy roadmap across forty work streams, covering everything from rationalizing vendor contracts to consolidating ERP systems. And every single initiative has a business owner accountable for its bottom-line savings. Every week, analysts in the IMO are going to reconcile the numbers against the general ledger.
- 3:32
As they track down status from all forty leads, they're also comparing actuals against the plan, then finally assembling the executive deck for the steering committee, which is going to include the CFO, the chief risk officer, business unit heads, and the integration lead. The engineering team builds an agent to automate that first draft. The agent then
- 4:02
ingests the weekly updates, reconciles the ledger, runs variance math against the plan, and flags the initiatives that are falling behind. Everything looks good, and they decide to run a four-week pilot. The agent's drafts match the analyst reports line for line. So we can say that the tech works. Now the question is: What value does that steering
- 4:32
committee need before they can trust it to run the business? First, the steering committee needs a written value case agreed upon before the agent ever touches production data. In our example, that comes down to three specific metrics. First, let's look at cycle time. If that weekly report eats five business days to compile right now, you're gonna
- 5:01
wanna set a hard target such as two days. Your second metric will be analyst capacity. If four analysts spend half of their week building this deck, that is eighty hours a week the agent gives back. That time counts as value only when the integration lead assigns it to the work streams that are behind on their synergy targets and need help getting back on
- 5:31
track. Then you only count that value after netting out the compute, licensing, and human review costs of running the agent. Your third metric is the most important one: detection time. That is how long it takes from the first sign of a slip in the data to the moment the steering committee sees it. Cutting the report from five days to two days does not
- 6:01
guarantee that the committee sees that slip any sooner The agent has to catch it, and the value case measures that directly. Every single metric requires a pre-deployment baseline. If the IMO cannot state the baseline today, do not deploy. If you can't measure where you started, you can never prove the agent moved the needle. Next, the steering committee
- 6:31
needs to know who owns the risk the agent creates. We are going to apply the three lines model to the agent. In the first line, management owns the controls. The integration lead is the accountable executive. She owns the agent's output exactly the way she owned the manual deck. In the second line, risk and compliance oversee the agent and
- 7:01
challenge how to run it. How deep they go depends on the agent's exposure. An internal draft scrubbed by a senior analyst warrants a very different review standard than an autonomous agent publishing figures straight to the board. In the third line, internal audit provides assurance, deciding based on material risk when and how the agent enters the annual
- 7:31
audit plan. The agent also needs one employee assigned to oversee it every day. In our example, that is the senior analyst who reviews the draft before it reaches the committee. Her role requires four specific capabilities. She has to first understand the operational boundaries. She has to interpret its output with context. She must
- 8:00
have the authority to override or reverse it, and she needs a clear kill switch to shut it down safely the second it behaves unexpectedly.
- 8:14
Accountability also means defining where the agent's authority stops. I document this in a one-page policy called the Human Work Standard. For every fork in the process, it maps the decision, the human role authorized to make it, the required evidence, and the escalation path. These decisions exist at every tier. The senior analyst decides whether
- 8:44
a variance is an accounting timing difference or a real cash shortfall. The workstream lead decides how to remediate that shortfall, and the integration lead is going to decide whether to formally flag an initiative as at risk to the steering committee. The agent prepares the analysis behind every one of those decisions, and it stops there. The person who makes the
- 9:14
decision owns the consequence. So keeping these decisions with your team does not slow the agent down. It can go into use while each role keeps its authority. The one reason to deli-delay deployment is a decision with no assigned owner. This means if leadership has not agreed who declares an initiative off track, the agent's
- 9:44
flags lead to no action. The third question is where the engineers in this room come in. The evidence for greater autonomy comes from how the agent is built. I look for three artifacts. The first is an auditable decision log. For every workstream the agent evaluates, it records the raw data ingested, the tool
- 10:13
calls executed, the prompt and the model versions, the output generated, along with the human sign-off. Two engineering choices make that log airtight. First, your core math and reconciliation rules must run in deterministic finance-approved code, not generated as conversational prose from an LLM.
- 10:43
Second, treat the model's written summary as a helpful explanation, not proof. Your real proof lives in the telemetry. What records were pulled? What deterministic tools ran? And who signed the review?
- 11:03
If reported savings do not match the general ledger, the agent does not touch the number. It flags the discrepancy and routes it up. The second artifact is the model inventory record. This captures the accountable executive, data lineage, dependencies across source systems, validation results, escalation paths, and the
- 11:32
kill switch runbook. Most importantly, it documents your regression triggers, which are any updates to a prompt, base model, or source API that require full revalidation before running in production again.
- 11:51
Your third artifact, this is going to be the autonomy scorecard. The steering committee uses it to grant autonomy in four stages. Stage one is shadow mode. The analyst built the report as they do today. The agent runs right alongside them, and the team compares the two Stage two is the supervised draft. The agent compiles the first draft, and
- 12:20
the senior analyst reviews every single line item. Stage three is the exception and sample, where the analyst reviews flagged initiatives plus a random sample of the clean ones. Then we have stage four, where it's exceptions only. The analyst reviews only high-risk anomalies supported by periodic independent sampling. Pay
- 12:50
close attention to stage four, however, because once humans only look at exceptions, your biggest vulnerability is what the agent failed to flag. So I advise tracking missed material issues through independent sampling, monitoring error severity, and watching your override rate carefully. A falling override rate does not automatically mean the agent is getting smarter. It can also mean the
- 13:20
depth of review has slipped. So independent sampling tells you which one of these you are seeing. The scorecard puts those control metrics side by side with your value metrics: cycle time, analyst hours deployed, and your detection time. And with that single-page view, the steering committee can make clean, efficient, data-backed decisions to either promote the agent, hold
- 13:50
it where it is, step it back or down to supervised review stage. So let's come back to the three questions. Ask them of every agent you build, fund, or govern. What value does it create? Who is accountable for it? And what evidence permits it to operate with autonomy? In our M&A
- 14:20
example today, the agent does not magically create the four hundred million in synergies. Procurement, supply chain, and operating leaders capture that value through the gritty work of integration. But what the agent delivers is clear: verified evidence weeks ahead of schedule, giving leadership the runway to intervene while the deal's synergies can still be captured. Building an agent that
- 14:50
works is just the first step. Answering those three questions is what earns it the trust to run at scale. Thank you.