← All AI Engineer talks

AI Engineer World's Fair 2026

The engineer of the future is the person who is able to choose what is worth doing — Addy Osmani

Read the talk

Choose the work, own the verdict

As agents take on more software work, engineering shifts toward choosing worthwhile problems, designing verification, and remaining answerable for what ships.

From a talk by Addy Osmani

What is worth doing, and who stands behind it?

Should this work ship? Should it be blocked, redirected, or accepted with a known risk? Those production decisions remain consequential even when an agent does most of the implementation. Addy Osmani opens with the human responsibility behind them: choosing what is worth doing, then owning the evidence, the understanding, and the verdict around automated work.

Black slide with white, yellow, and purple text describing the engineer’s role in increasingly automated work, with the speaker inset at left.
Engineers choose what is worth doing and own the evidence, understanding, and verdict.

Quality produces evidence; a verdict assigns responsibility. Tests and other checks help establish whether work meets a standard. Someone still has to decide what that evidence warrants and remain answerable for the decision. Keeping a human in the loop means preserving that responsibility, not simply arranging for a person to see the output.

This changes how engineering roles fit together. Osmani credits Boris Cherny with useful language for craft boundaries that are becoming blurry: ownership increasingly follows the work rather than a job title. Prototype, build, sweep, grow, and maintain are distinct engineering modes, and agents can help with all of them. The scarce judgment is deciding which mode the product needs, what quality bar applies, and who owns the result.

0:400:54
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:40 · section reference included

From a model to a software factory

A model alone is not the whole coding system. Harness engineering surrounds it with context, tools, a filesystem, and Git—the environment that makes its capabilities usable for delegated work. Loop engineering adds repeated prompting, checking, remembering, and decisions about what happens next. Instead of asking for one answer, the engineer designs a process that can continue working. That is where agents begin to behave like infrastructure.

Put those pieces together and the result is a software factory, a concept Osmani connects to Dex’s earlier talk. Agents operate inside the execution loop and produce evidence. Humans make the production decisions around it. The purpose is to move human judgment to the checkpoints where it has the greatest effect, rather than requiring continuous intervention in every execution step.

2:332:44
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

2:33 · section reference included

Clean code helps the next agent

As AI-assisted code becomes an ordinary part of repositories, answerability becomes an engineering requirement. Osmani cites Sonar’s 2026 State of Code Developer Survey to illustrate that shift. Maintainability matters for the same reason it always has—someone must be able to understand the code—but the next reader may now be an agent as well as a teammate.

The Sonar study Does Code Cleanliness Affect Coding Agents? separates task success from the cost of reaching it. In the controlled comparison using Claude Code with Sonnet 4.6, clean repositories had roughly the same task pass rates as messy repositories, with 7–8% fewer tokens and about 34% fewer file revisits. These are results from the studied repository pairs and tasks, with variation across tasks, rather than a guarantee for every agent or codebase. The useful distinction is that an agent can reach a similar result while spending less effort reading and revisiting the system.

Slide reading “Clean code is cheaper for agents to read,” with a yellow line stating “7–8% fewer tokens. 34% fewer file revisits. Same pass rate.”
Clean code is cheaper for agents to read: 7–8% fewer tokens, 34% fewer file revisits, same pass rate.
3:353:47
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:35 · section reference included

Distrust without bandwidth

Making generation cheaper does not automatically make review cheaper. Engineers can be skeptical of AI-generated code and still lack the capacity to check everything it produces. In Sonar’s survey, 96% of respondents did not fully trust the functional correctness of AI-generated code, while 48% completely agreed that they always check AI-assisted code before committing. These are reported attitudes and practices, not observed defect rates; the second figure does not mean everyone else never checks. Osmani’s concern is the gap between distrust and the bandwidth to act on it.

Verification must become cheaper, clearer, and harder to skip. At organizational scale, adoption can move faster than governance, leaving review and validation as bottlenecks. A useful record of delegated work must let someone answer several connected questions: Did a model touch this file? What constraints guided it? What evidence did it produce? What risk was accepted, and who owns the result?

Osmani briefly invokes Homer Simpson’s computer automation as the comic version of a future with little human involvement. The serious problem is that an agent can produce more change than a person can comprehend. When generation scales faster than comprehension, judgment backed by evidence becomes scarce.

4:214:36
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

4:21 · section reference included

Alpha, decay, and taste that can be taught

Where does human judgment continue to create value? Osmani introduces two terms for thinking about that question. Alpha is the gap between what a person can do today and what current models can do. Decay is the clock on that gap. A capability can be valuable without remaining a durable advantage as the model frontier advances.

Taste is one proposed answer. Osmani attributes to Paul Graham the observation that when making things becomes easier, choosing what to make becomes more important. But taste can also become a vague name for work that has not yet been explained. He favors a definition he attributes to Mitchell Hashimoto: the ability to make high-quality qualitative judgments where an objective metric does not yet exist. That places taste before a benchmark can settle the question, or before the market has fully expressed a preference.

Model-generated interfaces make this concrete. Looking at the UX an agent creates, a person may recognize that an experience works—or that something is wrong—before having a metric for the difference. If generating ten options is cheap, the valuable contribution is choosing which option deserves to exist. To improve future decisions, that judgment must become critique and examples that a team or system can learn from. Taste remains useful, but treating it as an eternal moat misses how learning works.

The decay test applies across the capabilities engineers have relied on:

CapabilityWhat changes its advantage
SpeedModels absorb more execution work.
RecallHarnesses provide memory.
VerificationEvals, static checks, and model critique move into the harness.
TasteModels learn from examples and preferences.

Osmani expects taste to decay more slowly, but even judgment is a slope rather than an impermeable boundary. The career strategy is to keep moving to the next level of responsibility instead of defending one capability forever.

That shifts the question from what an agent cannot do to what a human must be answerable for. More people can now make computers do useful things, expanding access to building software. Engineering still requires reasoning about systems, understanding constraints, defending trade-offs, managing risk, and being reachable when something breaks. Those responsibilities extend beyond producing an implementation.

6:066:22
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

6:06 · section reference included

A passing build can conceal lost understanding

Cognitive debt is the erosion of understanding and memory as more problem solving is deferred to AI. In a repository, it appears as a gap between how much code exists and how much any human on the team understands. A build can pass its tests and a PR can be ready to merge while the team loses its ability to explain the system it is shipping. Passing checks and retaining comprehension are different properties.

Delegation depth makes this harder. A thirty-second agent run feels like an interaction; a task that runs for an hour or a day is a workstream. An agent can remain inside the system long enough for the human to lose the thread, especially when several long tasks run in parallel. Review at that scale cannot be a glance at the final result. It has to become a control system.

Slide with three horizontal bars labeled greater than 30 minutes, one hour, and eight hours of human-equivalent tasks, showing 80.6%, 70.2%, and 25.6%, plus a greater-than-60-hour callout.
Delegation depth is now real: long, parallel tasks demand answerable delegation.
9:489:59
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

9:48 · section reference included

Borrowed confidence and the orchestration tax

Cognitive surrender goes further than losing familiarity with code: it means accepting an AI answer before forming an independent judgment. Delegation asks the agent to do the work and return enough evidence for a person to judge it. Surrender substitutes the agent’s answer for that judgment.

Osmani cites Wharton research as a warning about borrowed confidence. In the cited reasoning experiments, participants accepted the incorrect AI output in 73.2% of trials where they consulted AI and it supplied a wrong answer. The research also reports increased confidence following errors. These were reasoning experiments, not software-review measurements, but they illustrate why confidence in an answer cannot substitute for evidence about its correctness.

A third failure mode is orchestration tax. Running hundreds or thousands of agents does not create more human attention. Every additional loop introduces decisions about routing, merging, verification, and integration. Human cognitive bandwidth does not parallelize with the agent count.

The corrective is not necessarily to run fewer agents. It is to design attention deliberately: where a person enters the process, what information they acquire there, and what they can reuse. Parallel execution only helps if the resulting decisions remain manageable.

11:0411:22
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

11:04 · section reference included

Accountability makes delegation scalable

Accountability can sound like an extra burden, but it is what allows the larger system to scale. As agents do more work, faster and in parallel, someone must explain the intent, inspect the evidence, accept the risk, and improve the system when a decision turns out to be wrong.

Osmani frames the career distinction as the half-life of an edge versus the half-life of a signature. An advantage in speed, recall, verification, or taste might disappear with a model release; that is a strategic metaphor, not a measured duration. A signature is the person, team, or institution standing behind the shipped work. Credibility built through that responsibility can last longer than any particular capability advantage. Skills create leverage; accountability turns it into trust.

Agents can choose, route, merge, escalate, and operate within policy. In many systems, they should. But authority to execute does not transfer responsibility for consequences. An agent can follow a runbook without becoming the party that bears the cost when it fails. The questions remain: Who understood the policy? Who accepted the risk? Who owns the blast radius?

High agency means actively owning outcomes: knowing when to delegate, inspect, stop, and put your name on the result. Personally doing everything does not scale. Osmani’s agency ladder moves from flagging a problem through executing, diagnosing, proposing, recommending, and resolving it. The final step is discernment—deciding whether the problem deserves investment at all. When agents make more paths possible, choosing not to pursue one can be the responsible decision.

12:3812:49
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

12:38 · section reference included

The handoff is evidence and responsibility

The operating model separates an inner execution loop from an outer engineering loop:

LoopWorkRole
InnerInvestigate, implement, test, reportExercise capability.
OuterDecide, verify, approve, ownExercise agency.

Agents can run much more of the inner loop. The outer loop determines which work deserves attention and what can responsibly reach production.

The agent’s handoff is an evidence package appropriate to the task: diffs, tests, logs, rationale, traces, trajectories, or screenshots. The engineer then decides whether the work was worth doing, whether the evidence is sufficient, and whether to approve or redirect it. Whoever approves the result must own what reaches production. This boundary applies whether a team uses a few agents or thousands: seeing AI output is not the same as accepting responsibility on the basis of evidence.

Osmani makes the release rule explicit: “Explain it or don't ship it.” This does not require a human to type every line or even read every line. It requires someone to understand the work well enough to defend it.

Ownership files in large codebases provide a familiar analogy. Particular directories or architectural areas have people who are on the hook for them. Agent-written changes still need that relationship between a system and its accountable owners. Before release, those owners must be able to explain the changes, identify the supporting evidence, and understand the risks they are accepting.

15:0715:21
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

15:07 · section reference included

Cheaper software expands the work of engineering

Automation raises the floor, and engineering moves up a level. The work increasingly includes loop design, evidence design, and brownfield stewardship—caring for existing systems while agents change them. Fewer keystrokes leave more software surface area needing taste, verification, ownership, and care.

Osmani closes with an optimistic historical analogy. Higher-level languages, frameworks, cloud, and low-code tools made software easier to create. Lower costs brought previously infeasible ideas within reach, revealing latent demand. He expects agents to extend that pattern: more software becomes possible, and the bottleneck moves from whether it can be built to whether it should exist and whether someone can answer for it. That demand expansion is his forecast, with engineering responsibility at its center.

Purple-and-black closing slide stating that easier software writing led to exponentially more software, with a yellow sentence about making agent work legible, verifiable, and worth shipping.
Easier software creation leads to more software; engineers make agent work legible, verifiable, and worth shipping.

Build the factories, keep the lights on, and own the verdict.

16:5217:07
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

16:52 · section reference included

Resources

From the talk

Read the complete timestamped transcript
  1. 0:00

    [on-hold jingle] Howdy, folks.

  2. 0:23

    So good afternoon or good whatever time it is when you're watching this on YouTube. I'm really excited to be here. And, um, today I want to talk to you about really, uh, what it takes to keep the human in the loop where engineering is concerned.

  3. 0:40

    I really wanna start with the human side before we talk about the architecture here. I think that the engineer of the future is gonna be really defined by the person who is able to choose what is worth doing.

  4. 0:54

    They're gonna own the evidence, they're gonna own the understanding, as well as the verdict around increasingly automated work that's being done by agents. Now, when I use the term verdict, I don't mean that we're suddenly all gonna be Judge Judy.

  5. 1:10

    We're not. But what I mean really is something just a little bit different. I mean, we're gonna be accountable for the production decisions. Does something shift? Do we block it?

  6. 1:22

    Do we redirect it or accept the risk? Quality is something that we all talk about a lot, but quality produces evidence. A verdict assigns responsibility, and answerability is really what lets us stand behind a verdict.

  7. 1:39

    And this, of course, is not the only way that our industry is starting to think about our roles evolving.

  8. 1:46

    Boris Cherny recently put some useful language around what many teams are starting to feel. The old craft boundaries are getting blurry, and roles are rebundling around the work itself.

  9. 1:58

    And the important question here becomes a lot less about what is your title and more what part of the system can you own.

  10. 2:06

    Now, I like this taxonomy quite a lot. Um, it's optimistic without being overly vague, so things like prototype, build, sweep, grow, and maintain. And these are real engineering modes.

  11. 2:20

    Agents are gonna help with all of them, but the scarce thing is not merely doing the task. It's gonna be knowing which mode your product needs and what quality bar applies, and who owns the result at the end of the day.

  12. 2:33

    Now, we've been talking about harnesses and loop engineering and software factories over the last couple of days. We can talk why this shift is happening. We've moved past the model as the whole story, right?

  13. 2:44

    With harness engineering, the coding agent is the model plus the harness around it, right? Your context, your tools, your file system, Git. And the harness is what turns intelligence into something that you can delegate to.

  14. 2:56

    The next move was loop engineering, where we weren't just prompting one run anymore. We were designing systems that kept prompting, checking, and remembering, and deciding what happened next. And that's really when agents started to feel like infrastructure.

  15. 3:10

    And once you start putting all of those things together, you get that software factory. Dex covered this well in his talk. But you have agents that are running inside that inner loop and evidence that comes out.

  16. 3:22

    Humans still end up making the production decisions in this loop, and the win really isn't moving us from it. The win is moving human judgments the highest leverage checkpoint, I think.

  17. 3:35

    And this is why it starts to matter now. AI-generated and AI-assisted code is becoming normal code for a lot of us. One of Sonar's twenty twenty-six surveys said that AI-assisted code is no longer marginal.

  18. 3:47

    It's increasingly having a large role in our code bases. And once that happens, answerability stops being this philosophical world. It becomes an engineering requirement. And there's a quality point here as well, right?

  19. 3:59

    Like, we used to care about clean code, code that people could read. But cleaner code is actually not just gonna help the next human and the next person on your teams.

  20. 4:09

    It actually helps the next agent. Another one of Sonar's research, uh, studies found that clean and messy repos had roughly the same pass rates, but clean code actually used fewer tokens and caused fewer revisits.

  21. 4:21

    So there's a lot of benefit to maintainability that can fuel efficiency for your factories. Now, making generation cheaper does not automatically make review cheaper, right? I think a lot of us are facing this moment, and we know that engineers are not naive.

  22. 4:36

    The Sonar numbers say that almost everybody is skeptical of AI code. Now, I love working in my software factory. I love building my engineering loops. But the problem is still capacity.

  23. 4:48

    If ninety-six percent of people don't fully trust that code, but only about half always verify before committing, we have this danger that we've got distrust without bandwidth. And so safety comes from making verification cheaper, clearer, and harder for people to skip.

  24. 5:04

    And if you zoom out from the individual reviewer to the organization, review and validation start becoming a bottleneck when governance isn't able to catch up and adoption is already moving way faster than any company can go and set their policies.

  25. 5:18

    And this means that we have some hard questions we have to deal with, like did a model actually touch this file? And the hard questions are also like what constraints guided that work?

  26. 5:27

    What evidence was produced? What risk was accepted, and who owned the result? Now, the agent can ship more than any of us can review, right? So what are we still good for?

  27. 5:40

    I think it's a question that's on a lot of our minds, right? And, you know, if Homer Simpson's experience automating computers can teach us anything, maybe this is our future.

  28. 5:51

    I don't think it is, but it's one direction things could take. Now, let's try that again. If change is where humans enter the loop, if generation scales faster than comprehension, the scarce resource becomes judgment that's backed by evidence.

  29. 6:06

    So the question is no longer how much can the agent do, but where does human judgment still create leverage? Now, I want to talk to you about two terms that I'm going to use for the career part of this talk, alpha and decay.

  30. 6:22

    Alpha is the gap between what you can do today and what current models can do. That gap is a very real thing, and decay is the clock on that gap.

  31. 6:34

    If the thing that makes you special is a capability, the frontier is eventually going to come for it, right? And there's a whole conversation around this. This is one of the reasons why taste keeps coming up.

  32. 6:47

    Paul Graham had a point here that I think is very right. When anyone can make anything, choosing what to make becomes very important, and I buy that. But I also think that we have to be very careful because taste can become a magic word for whatever part of the work we don't want to explain just yet.

  33. 7:06

    Mitchell Hashimoto gave us a more useful version of this definition. Taste is the ability to make high-quality, qualitative judgments where no objective metric exists yet. That matters because it puts taste before the benchmark and before the market has fully voted.

  34. 7:22

    When you try out a model and you see the kind of UX and the kind of experiences that it builds, you can often tell when you think it has taste or lacks taste, or where there's a gap there that humans can fill.

  35. 7:34

    Now, this is also only useful if we can turn some of this concept around taste into critique, examples, and better judgment over time. So yes, taste matters when production gets cheaper, and if anyone can generate ten options, the scarce skill is really knowing which option deserves to exist.

  36. 7:54

    But taste is not some eternal moat. It's alpha as well. Now, the people with taste are still going to matter. I personally think they're still going to matter for a long time.

  37. 8:06

    But the best version of that skill is not mystique. It's making better calls and leaving behind examples that your team and the system can learn from. Now, let's apply the decay test.

  38. 8:19

    Well, we used to have speed. That decayed. We used to have recall. You know, harnesses have memory. Verification is moving into harnesses, evals, static checks, and model critique. Taste, I continue to think this is going to decay much more slowly, but it still resets as models learn from examples and preferences.

  39. 8:38

    Even judgment, in some ways, is a slope rather than a wall. So the strategy is not to cling to any one capability. It's for us to keep moving our edges up a level.

  40. 8:48

    So this is one of the reasons why what can the agent do is not the best strategic question anymore. The list of things that agents can't do just keeps shrinking.

  41. 8:58

    The better question for us is really what can only a human be answerable for? Not because, you know, any of us are, are magical in any way, but because some decisions actually require ownership.

  42. 9:10

    They require context, risk acceptance, and responsibility after that work ships. This is why the word engineer has to get just a little bit stricter. More people than ever can now make computers do things, and I think that's truly awesome.

  43. 9:26

    The total addressable market for builders has never been larger, and that's so cool. But it's a huge expansion of the leverage. An engineer is not merely somebody who can code, you know, and, and get things to exist.

  44. 9:39

    An engineer can reason about systems. They think about constraints. You defend trade-offs. You can manage risk, and you're the person that can be reached out to when things start to break.

  45. 9:48

    So what are things that engineers should avoid if we want to stay effective ac- and accountable in this moment? Well, the first thing to avoid really is cognitive debt.

  46. 9:59

    Now, cognitive debt is the erosion of your understanding and memory around how to solve problems. I think a lot of us start to feel this the more that we're using agents every single day.

  47. 10:09

    I know that I feel this a lot, and it's because we're deferring more and more to AI to solve our problems. For code, it's the gap between how much code exists in your repo and how much any human on your team genuinely understands.

  48. 10:23

    And this is why things like delegation depth end up mattering. You can have a build that passes, you know, your tests, a PR that you can merge, but your s- team can still end up losing its ability to actually explain the system that they are shipping to production.

  49. 10:38

    Now, a very real pressure is almuch-- is also how much we delegate. So agents can now stay inside the system long enough for the human to lose the thread.

  50. 10:47

    So a thirty-second run, right, can feel like an interaction, but an hour or a day scale task, so something long horizon, that's a work stream. And when tasks can end up l- you know, lasting that long, especially when you begin running many of them in parallel, review can't just be a glance at the end.

  51. 11:04

    It has to become a whole control system. The second thing to avoid is cognitive surrender. Now, this is when you blindly accept AI's, um, responses. Like, delegation is important because delegation says, "Do the work, then show me enough evidence that I can judge it."

  52. 11:22

    I still make a judgment in that situation. Surrender is really saying, "Hey, your answer is now my answer before I have formed any opinions myself." Now, uh, Wharton did a study that kind of offers us a warning light here.

  53. 11:36

    When AI was wrong, seventy-three percent of people still s- thought that they, they, you know, they picked the wrong answer, and they felt more sure. So the failure mode is not using AI, but it's borrowed confidence.

  54. 11:50

    The third thing to avoid is orchestration tax. Now, if you've been in the Bay Area, you will see people who, for better or worse, are still walking around with their laptops open or are talking to you about cloud agents.

  55. 12:01

    And we're increasingly trying to run more and more and more in parallel or telling each other that we're shipping with hundreds of agents or thousands of agents. More AI agents running does not mean that there is more of you available.

  56. 12:15

    Your cognitive bandwidth does not parallelize. So every loop that you create ends up causing more decisions to route, merge, verify, and integrate. And the fix is not necessarily fewer agents, but it's about designing your attention like a system.

  57. 12:31

    Like where you enter, what you acquire, what you reuse. You just wanna be very intentional about it.

  58. 12:38

    Now, accountability can be a scary word for a lot of people, and I wouldn't be surprised if it made you wanna go hide in the bushes and just tell your agent to deal with it.

  59. 12:49

    But accountability is not what remains after agents get good. It's what lets the rest of the whole system scale. If agents can do more work, if they can do it faster, in parallel, better than what many of us could do, the scarce thing becomes the ability to explain intent, to inspect evidence, to accept risk, and improve the

  60. 13:10

    system when the decision was wrong. Now, here is the career math. The half-life of an edge might be one model release. Speed, recall, verification, even taste all move as the frontier moves.

  61. 13:26

    But the half-life of a signature, your credibility, your expertise, is much longer. And by signature, I really mean the name on the work, the person, the team, the institution, whoever stands behind what's actually shipped.

  62. 13:41

    So skills can earn leverage. Accountability can turn leverage into trust. And this is one of the lines that I wanna draw pretty clearly. Agents can choose, they can route, they can merge, they can escalate, they can operate inside policy.

  63. 13:54

    And in many systems, you know, they can, they should. But execution and responsibility are very different things. The agent can follow your runbook, but it can't inherit the consequences.

  64. 14:04

    When something fails, the question is: Who understood the policy? Who accepted the risk, and who owns the blast radius? High agency is something that a lot of us talk about these days as being, like, this thing that we're looking for when we're hiring.

  65. 14:18

    High agency is actively taking ownership of your outcomes. So knowing when to delegate, when to inspect, when to stop, and when to put your name on the result. High agency in this world is not, "I personally do everything."

  66. 14:31

    You know, that version doesn't really scale. It's not just hustle theater, but it's ownership with judgment attached. This agency ladder tries to make that a little bit more concrete.

  67. 14:43

    At the bottom, you've got someone that flags a problem and leaves it for the system. Higher up, they execute, diagnose, propose, recommend, and resolve. And the rare top movement is discernment.

  68. 14:55

    You know, maybe you find a problem and you decide whether or not it's worth investing in. Maybe it's not, and maybe you move on. But when agents make more paths possible, agency is not chasing every single path.

  69. 15:07

    It's really just deciding which paths deserve your ownership and attention. So translate that into an operating model. Agents can run much more of the inner execution loop. They can investigate, implement, test, and report.

  70. 15:21

    I think that there's leverage in that. But that outer loop is still engineering. So deciding, verifying, approving, owning. That inner loop is capability. The outer loop is agency.

  71. 15:33

    And this is a boundary that I really care about. Your agent returns evidence. It returns diffs, tests, logs, rationale, traces, trajectories, screenshots, whatever the work itself requires. But then the engineering really begins.

  72. 15:48

    We decide whether the work was worth doing. We verify whether the evidence is enough, and we approve or redirect or own what reaches production. It doesn't matter if you're someone that's just working with a small number of agents or whether you're working with thousands of agents.

  73. 16:03

    I still very much think that these ideas apply. So the boundary is not human looks at AI output. The boundary is evidence and responsibility.

  74. 16:13

    So here's an operational rule. Explain it or don't ship it. And it's not because humans have to type every line or read every line, but because someone has to understand the work well enough to defend it.

  75. 16:25

    If you've ever worked in a large code base or an enterprise code base, some code bases have this concept of an owner's file or cer-certain subdirectories where there are people who are on the hook for that part of the system.

  76. 16:36

    You can think about this in a very similar way. Who's accountable for that part of your architecture and your code base? Your model might write the code, and the question is really still whether you can explain those changes that the agent is shipping, whether you've got the evidence where you understand the risks.

  77. 16:52

    Now, this is one of the things I want you to remember near the end. Automation moves the floor for all of us. Engineering continues to move up a level, and our new work might be loop design, evidence design, and brownfield stewardship.

  78. 17:07

    But fewer keystrokes doesn't mean less engineering over the next few years. It means that there is more surface area that needs taste, verification, ownership, and ultimately care.

  79. 17:20

    I don't think I've ever been more excited about the future of this field. Every time that we have made it easier to write software, we've predicted that the world would need less of it, and in fact, the opposite happened.

  80. 17:33

    Higher level languages happened, frameworks, cloud, low code. The pattern always went the other way. And when you lower the cost, latent demand ends up appearing. Those ideas that people didn't think were feasible to build and get out there are suddenly unlocked.

  81. 17:48

    And agents are gonna do the same thing for a lot of people. It's not gonna remove engineering work. It's gonna move the bottleneck from, "Can we build this?" to, "Should this exist, and can we answer for it?"

  82. 17:59

    So build the factories, keep the lights on, own the verdict. I hope this was useful. Thank you. [audience applauding] [upbeat music]