[
  {
    "startMs": 719,
    "text": "Hi, I'm Dimmitri. In this session, I"
  },
  {
    "startMs": 3510,
    "text": "Hi, I'm Dimmitri. In this session, I"
  },
  {
    "startMs": 3520,
    "text": "Hi, I'm Dimmitri. In this session, I will show how I work on maintaining"
  },
  {
    "startMs": 5590,
    "text": "will show how I work on maintaining"
  },
  {
    "startMs": 5600,
    "text": "will show how I work on maintaining large AI coding projects. Coding agents"
  },
  {
    "startMs": 8790,
    "text": "large AI coding projects. Coding agents"
  },
  {
    "startMs": 8800,
    "text": "large AI coding projects. Coding agents made code cheap. They made entropy even"
  },
  {
    "startMs": 12709,
    "text": "made code cheap. They made entropy even"
  },
  {
    "startMs": 12719,
    "text": "made code cheap. They made entropy even cheaper. In the Marvel movie, Thanos"
  },
  {
    "startMs": 15589,
    "text": "cheaper. In the Marvel movie, Thanos"
  },
  {
    "startMs": 15599,
    "text": "cheaper. In the Marvel movie, Thanos watched his home planet Titan collapse"
  },
  {
    "startMs": 18310,
    "text": "watched his home planet Titan collapse"
  },
  {
    "startMs": 18320,
    "text": "watched his home planet Titan collapse under its own growth. So, when the"
  },
  {
    "startMs": 20630,
    "text": "under its own growth. So, when the"
  },
  {
    "startMs": 20640,
    "text": "under its own growth. So, when the universe got crowded, he raised half of"
  },
  {
    "startMs": 23590,
    "text": "universe got crowded, he raised half of"
  },
  {
    "startMs": 23600,
    "text": "universe got crowded, he raised half of everything. This talk is about the one"
  },
  {
    "startMs": 26950,
    "text": "everything. This talk is about the one"
  },
  {
    "startMs": 26960,
    "text": "everything. This talk is about the one time I did the same in one project. Our"
  },
  {
    "startMs": 30070,
    "text": "time I did the same in one project. Our"
  },
  {
    "startMs": 30080,
    "text": "time I did the same in one project. Our code was growing the way Titan did. When"
  },
  {
    "startMs": 32950,
    "text": "code was growing the way Titan did. When"
  },
  {
    "startMs": 32960,
    "text": "code was growing the way Titan did. When I found what my agents had done, I"
  },
  {
    "startMs": 36950,
    "text": "I found what my agents had done, I"
  },
  {
    "startMs": 36960,
    "text": "I found what my agents had done, I deleted tests and boil the plate code"
  },
  {
    "startMs": 40790,
    "text": "deleted tests and boil the plate code"
  },
  {
    "startMs": 40800,
    "text": "deleted tests and boil the plate code nobody used. I had to rewrite the whole"
  },
  {
    "startMs": 43670,
    "text": "nobody used. I had to rewrite the whole"
  },
  {
    "startMs": 43680,
    "text": "nobody used. I had to rewrite the whole project and I lost some useful pieces."
  },
  {
    "startMs": 46310,
    "text": "project and I lost some useful pieces."
  },
  {
    "startMs": 46320,
    "text": "project and I lost some useful pieces. And that's the dilemma. Drown and chaos"
  },
  {
    "startMs": 49350,
    "text": "And that's the dilemma. Drown and chaos"
  },
  {
    "startMs": 49360,
    "text": "And that's the dilemma. Drown and chaos or break what people use. And here we'll"
  },
  {
    "startMs": 53189,
    "text": "or break what people use. And here we'll"
  },
  {
    "startMs": 53199,
    "text": "or break what people use. And here we'll build the third option for that project."
  },
  {
    "startMs": 56630,
    "text": "build the third option for that project."
  },
  {
    "startMs": 56640,
    "text": "build the third option for that project. The rewrite didn't hold. The agents kept"
  },
  {
    "startMs": 59990,
    "text": "The rewrite didn't hold. The agents kept"
  },
  {
    "startMs": 60000,
    "text": "The rewrite didn't hold. The agents kept writing and the mess grew back. So I"
  },
  {
    "startMs": 63270,
    "text": "writing and the mess grew back. So I"
  },
  {
    "startMs": 63280,
    "text": "writing and the mess grew back. So I drew a line above it. There is more"
  },
  {
    "startMs": 66390,
    "text": "drew a line above it. There is more"
  },
  {
    "startMs": 66400,
    "text": "drew a line above it. There is more change than anyone can check. The third"
  },
  {
    "startMs": 69510,
    "text": "change than anyone can check. The third"
  },
  {
    "startMs": 69520,
    "text": "change than anyone can check. The third option is to stay under it with small"
  },
  {
    "startMs": 72149,
    "text": "option is to stay under it with small"
  },
  {
    "startMs": 72159,
    "text": "option is to stay under it with small sweeps every week and feedback loops"
  },
  {
    "startMs": 75030,
    "text": "sweeps every week and feedback loops"
  },
  {
    "startMs": 75040,
    "text": "sweeps every week and feedback loops built into the system. Each chapter of"
  },
  {
    "startMs": 77510,
    "text": "built into the system. Each chapter of"
  },
  {
    "startMs": 77520,
    "text": "built into the system. Each chapter of this talk is one thing I had to learn to"
  },
  {
    "startMs": 79910,
    "text": "this talk is one thing I had to learn to"
  },
  {
    "startMs": 79920,
    "text": "this talk is one thing I had to learn to get there. Thanos needed six stones for"
  },
  {
    "startMs": 82870,
    "text": "get there. Thanos needed six stones for"
  },
  {
    "startMs": 82880,
    "text": "get there. Thanos needed six stones for one snap. Ours are six questions and"
  },
  {
    "startMs": 86230,
    "text": "one snap. Ours are six questions and"
  },
  {
    "startMs": 86240,
    "text": "one snap. Ours are six questions and they light up in the corner as we go."
  },
  {
    "startMs": 89109,
    "text": "they light up in the corner as we go."
  },
  {
    "startMs": 89119,
    "text": "they light up in the corner as we go. The first one is time. How do we stay"
  },
  {
    "startMs": 92149,
    "text": "The first one is time. How do we stay"
  },
  {
    "startMs": 92159,
    "text": "The first one is time. How do we stay under the line?"
  },
  {
    "startMs": 94230,
    "text": "under the line?"
  },
  {
    "startMs": 94240,
    "text": "under the line? Chapter one. To stay under the line. I"
  },
  {
    "startMs": 97190,
    "text": "Chapter one. To stay under the line. I"
  },
  {
    "startMs": 97200,
    "text": "Chapter one. To stay under the line. I first had to know what's right means"
  },
  {
    "startMs": 99590,
    "text": "first had to know what's right means"
  },
  {
    "startMs": 99600,
    "text": "first had to know what's right means here. I used to think that tests decide"
  },
  {
    "startMs": 102950,
    "text": "here. I used to think that tests decide"
  },
  {
    "startMs": 102960,
    "text": "here. I used to think that tests decide that. So what does right actually depend"
  },
  {
    "startMs": 106630,
    "text": "that. So what does right actually depend"
  },
  {
    "startMs": 106640,
    "text": "that. So what does right actually depend on?"
  },
  {
    "startMs": 108149,
    "text": "on?"
  },
  {
    "startMs": 108159,
    "text": "on? Let's keep one task in mind. Someone"
  },
  {
    "startMs": 110870,
    "text": "Let's keep one task in mind. Someone"
  },
  {
    "startMs": 110880,
    "text": "Let's keep one task in mind. Someone wants to change the amount on an order"
  },
  {
    "startMs": 113830,
    "text": "wants to change the amount on an order"
  },
  {
    "startMs": 113840,
    "text": "wants to change the amount on an order we already approved. Two kinds of agents"
  },
  {
    "startMs": 116630,
    "text": "we already approved. Two kinds of agents"
  },
  {
    "startMs": 116640,
    "text": "we already approved. Two kinds of agents meet here. One wrote the instructions"
  },
  {
    "startMs": 119749,
    "text": "meet here. One wrote the instructions"
  },
  {
    "startMs": 119759,
    "text": "meet here. One wrote the instructions and the other follows them in"
  },
  {
    "startMs": 121830,
    "text": "and the other follows them in"
  },
  {
    "startMs": 121840,
    "text": "and the other follows them in production."
  },
  {
    "startMs": 124069,
    "text": "production."
  },
  {
    "startMs": 124079,
    "text": "production. We run this in 110 countries with about"
  },
  {
    "startMs": 127749,
    "text": "We run this in 110 countries with about"
  },
  {
    "startMs": 127759,
    "text": "We run this in 110 countries with about 10,000 scenarios of pros instructions."
  },
  {
    "startMs": 131350,
    "text": "10,000 scenarios of pros instructions."
  },
  {
    "startMs": 131360,
    "text": "10,000 scenarios of pros instructions. Every task lands in a slice. One process"
  },
  {
    "startMs": 134949,
    "text": "Every task lands in a slice. One process"
  },
  {
    "startMs": 134959,
    "text": "Every task lands in a slice. One process in one country. There's a second stone"
  },
  {
    "startMs": 137990,
    "text": "in one country. There's a second stone"
  },
  {
    "startMs": 138000,
    "text": "in one country. There's a second stone space. It asks where a change is allowed"
  },
  {
    "startMs": 141430,
    "text": "space. It asks where a change is allowed"
  },
  {
    "startMs": 141440,
    "text": "space. It asks where a change is allowed to go. By default, it stays inside its"
  },
  {
    "startMs": 145190,
    "text": "to go. By default, it stays inside its"
  },
  {
    "startMs": 145200,
    "text": "to go. By default, it stays inside its slice."
  },
  {
    "startMs": 147110,
    "text": "slice."
  },
  {
    "startMs": 147120,
    "text": "slice. Most of this system is pros about three"
  },
  {
    "startMs": 149589,
    "text": "Most of this system is pros about three"
  },
  {
    "startMs": 149599,
    "text": "Most of this system is pros about three quarters by my estimate. So pros needs"
  },
  {
    "startMs": 152309,
    "text": "quarters by my estimate. So pros needs"
  },
  {
    "startMs": 152319,
    "text": "quarters by my estimate. So pros needs engineering too. At start we borrowed"
  },
  {
    "startMs": 155270,
    "text": "engineering too. At start we borrowed"
  },
  {
    "startMs": 155280,
    "text": "engineering too. At start we borrowed mutation testing. You break one sentence"
  },
  {
    "startMs": 157830,
    "text": "mutation testing. You break one sentence"
  },
  {
    "startMs": 157840,
    "text": "mutation testing. You break one sentence on purpose and you watch for red test."
  },
  {
    "startMs": 161430,
    "text": "on purpose and you watch for red test."
  },
  {
    "startMs": 161440,
    "text": "on purpose and you watch for red test. Here almost none turned red. And if your"
  },
  {
    "startMs": 164550,
    "text": "Here almost none turned red. And if your"
  },
  {
    "startMs": 164560,
    "text": "Here almost none turned red. And if your wrapper is all code, your agent"
  },
  {
    "startMs": 167190,
    "text": "wrapper is all code, your agent"
  },
  {
    "startMs": 167200,
    "text": "wrapper is all code, your agent instructions and your tests are your"
  },
  {
    "startMs": 169750,
    "text": "instructions and your tests are your"
  },
  {
    "startMs": 169760,
    "text": "instructions and your tests are your pros. With agents, a rewrite is easy."
  },
  {
    "startMs": 173990,
    "text": "pros. With agents, a rewrite is easy."
  },
  {
    "startMs": 174000,
    "text": "pros. With agents, a rewrite is easy. The hard part is knowing what has to"
  },
  {
    "startMs": 176070,
    "text": "The hard part is knowing what has to"
  },
  {
    "startMs": 176080,
    "text": "The hard part is knowing what has to survive it. For code, tests can tell"
  },
  {
    "startMs": 179190,
    "text": "survive it. For code, tests can tell"
  },
  {
    "startMs": 179200,
    "text": "survive it. For code, tests can tell you. For pros, only people can. Agents"
  },
  {
    "startMs": 182790,
    "text": "you. For pros, only people can. Agents"
  },
  {
    "startMs": 182800,
    "text": "you. For pros, only people can. Agents can't build a complex system on their"
  },
  {
    "startMs": 185030,
    "text": "can't build a complex system on their"
  },
  {
    "startMs": 185040,
    "text": "can't build a complex system on their own. They fix what is easy to see and"
  },
  {
    "startMs": 188550,
    "text": "own. They fix what is easy to see and"
  },
  {
    "startMs": 188560,
    "text": "own. They fix what is easy to see and break consistency on the way. And people"
  },
  {
    "startMs": 191589,
    "text": "break consistency on the way. And people"
  },
  {
    "startMs": 191599,
    "text": "break consistency on the way. And people also get tired. So we spend their"
  },
  {
    "startMs": 193910,
    "text": "also get tired. So we spend their"
  },
  {
    "startMs": 193920,
    "text": "also get tired. So we spend their judgment only where it's needed. When"
  },
  {
    "startMs": 197350,
    "text": "judgment only where it's needed. When"
  },
  {
    "startMs": 197360,
    "text": "judgment only where it's needed. When business asked check with the team, it"
  },
  {
    "startMs": 200149,
    "text": "business asked check with the team, it"
  },
  {
    "startMs": 200159,
    "text": "business asked check with the team, it hides a real question. Is this a human"
  },
  {
    "startMs": 203030,
    "text": "hides a real question. Is this a human"
  },
  {
    "startMs": 203040,
    "text": "hides a real question. Is this a human step or can we automate it? Experts"
  },
  {
    "startMs": 205910,
    "text": "step or can we automate it? Experts"
  },
  {
    "startMs": 205920,
    "text": "step or can we automate it? Experts can't answer that. They don't see how"
  },
  {
    "startMs": 208550,
    "text": "can't answer that. They don't see how"
  },
  {
    "startMs": 208560,
    "text": "can't answer that. They don't see how the systems connect inside. So"
  },
  {
    "startMs": 210869,
    "text": "the systems connect inside. So"
  },
  {
    "startMs": 210879,
    "text": "the systems connect inside. So developers dig through the traces and"
  },
  {
    "startMs": 213110,
    "text": "developers dig through the traces and"
  },
  {
    "startMs": 213120,
    "text": "developers dig through the traces and logs with their coding agents and they"
  },
  {
    "startMs": 215589,
    "text": "logs with their coding agents and they"
  },
  {
    "startMs": 215599,
    "text": "logs with their coding agents and they decide which it is. In our task, the"
  },
  {
    "startMs": 218710,
    "text": "decide which it is. In our task, the"
  },
  {
    "startMs": 218720,
    "text": "decide which it is. In our task, the team leads decision stays human. The"
  },
  {
    "startMs": 221830,
    "text": "team leads decision stays human. The"
  },
  {
    "startMs": 221840,
    "text": "team leads decision stays human. The limit was data we could connect."
  },
  {
    "startMs": 225030,
    "text": "limit was data we could connect."
  },
  {
    "startMs": 225040,
    "text": "limit was data we could connect. Business experts see the rules."
  },
  {
    "startMs": 227589,
    "text": "Business experts see the rules."
  },
  {
    "startMs": 227599,
    "text": "Business experts see the rules. Developers see what's under the water."
  },
  {
    "startMs": 230390,
    "text": "Developers see what's under the water."
  },
  {
    "startMs": 230400,
    "text": "Developers see what's under the water. And that's where most bugs leave. They"
  },
  {
    "startMs": 233270,
    "text": "And that's where most bugs leave. They"
  },
  {
    "startMs": 233280,
    "text": "And that's where most bugs leave. They have their coding agents write those"
  },
  {
    "startMs": 235350,
    "text": "have their coding agents write those"
  },
  {
    "startMs": 235360,
    "text": "have their coding agents write those links down so the runtime can check"
  },
  {
    "startMs": 238149,
    "text": "links down so the runtime can check"
  },
  {
    "startMs": 238159,
    "text": "links down so the runtime can check them. Our guide for experts says it"
  },
  {
    "startMs": 240710,
    "text": "them. Our guide for experts says it"
  },
  {
    "startMs": 240720,
    "text": "them. Our guide for experts says it simply business tell us what we work out"
  },
  {
    "startMs": 244949,
    "text": "simply business tell us what we work out"
  },
  {
    "startMs": 244959,
    "text": "simply business tell us what we work out how. One document to readers. Agents"
  },
  {
    "startMs": 249190,
    "text": "how. One document to readers. Agents"
  },
  {
    "startMs": 249200,
    "text": "how. One document to readers. Agents read the blogs. So their blocks have to"
  },
  {
    "startMs": 251670,
    "text": "read the blogs. So their blocks have to"
  },
  {
    "startMs": 251680,
    "text": "read the blogs. So their blocks have to be exact. Experts read the text around"
  },
  {
    "startMs": 254710,
    "text": "be exact. Experts read the text around"
  },
  {
    "startMs": 254720,
    "text": "be exact. Experts read the text around them and they sign it. We keep one copy,"
  },
  {
    "startMs": 257749,
    "text": "them and they sign it. We keep one copy,"
  },
  {
    "startMs": 257759,
    "text": "them and they sign it. We keep one copy, a second one with drift and works both"
  },
  {
    "startMs": 260310,
    "text": "a second one with drift and works both"
  },
  {
    "startMs": 260320,
    "text": "a second one with drift and works both ways. Our code needs a plain description"
  },
  {
    "startMs": 262629,
    "text": "ways. Our code needs a plain description"
  },
  {
    "startMs": 262639,
    "text": "ways. Our code needs a plain description for experts too. Experts can only fix"
  },
  {
    "startMs": 266469,
    "text": "for experts too. Experts can only fix"
  },
  {
    "startMs": 266479,
    "text": "for experts too. Experts can only fix what they can see. Each of them reviews"
  },
  {
    "startMs": 269189,
    "text": "what they can see. Each of them reviews"
  },
  {
    "startMs": 269199,
    "text": "what they can see. Each of them reviews a task exactly the way the agent saw it."
  },
  {
    "startMs": 273030,
    "text": "a task exactly the way the agent saw it."
  },
  {
    "startMs": 273040,
    "text": "a task exactly the way the agent saw it. The node becomes the next change made by"
  },
  {
    "startMs": 275909,
    "text": "The node becomes the next change made by"
  },
  {
    "startMs": 275919,
    "text": "The node becomes the next change made by a coding agent and test it on the same"
  },
  {
    "startMs": 278469,
    "text": "a coding agent and test it on the same"
  },
  {
    "startMs": 278479,
    "text": "a coding agent and test it on the same task. So right depends on people. No"
  },
  {
    "startMs": 282469,
    "text": "task. So right depends on people. No"
  },
  {
    "startMs": 282479,
    "text": "task. So right depends on people. No single person knows it. A group of"
  },
  {
    "startMs": 285110,
    "text": "single person knows it. A group of"
  },
  {
    "startMs": 285120,
    "text": "single person knows it. A group of experts decides and that's why we bring"
  },
  {
    "startMs": 288390,
    "text": "experts decides and that's why we bring"
  },
  {
    "startMs": 288400,
    "text": "experts decides and that's why we bring them in from the start. You'll see the"
  },
  {
    "startMs": 291510,
    "text": "them in from the start. You'll see the"
  },
  {
    "startMs": 291520,
    "text": "them in from the start. You'll see the soul stone here a lot. We take it in"
  },
  {
    "startMs": 294230,
    "text": "soul stone here a lot. We take it in"
  },
  {
    "startMs": 294240,
    "text": "soul stone here a lot. We take it in chapter 4."
  },
  {
    "startMs": 296310,
    "text": "chapter 4."
  },
  {
    "startMs": 296320,
    "text": "chapter 4. Chapter two. Experts correct one task at"
  },
  {
    "startMs": 299510,
    "text": "Chapter two. Experts correct one task at"
  },
  {
    "startMs": 299520,
    "text": "Chapter two. Experts correct one task at a time while agents run the same pros"
  },
  {
    "startMs": 302870,
    "text": "a time while agents run the same pros"
  },
  {
    "startMs": 302880,
    "text": "a time while agents run the same pros all day. We track every outcome accepted"
  },
  {
    "startMs": 306550,
    "text": "all day. We track every outcome accepted"
  },
  {
    "startMs": 306560,
    "text": "all day. We track every outcome accepted or rejected. The accuracy shows us where"
  },
  {
    "startMs": 310550,
    "text": "or rejected. The accuracy shows us where"
  },
  {
    "startMs": 310560,
    "text": "or rejected. The accuracy shows us where people still need to look. I used to"
  },
  {
    "startMs": 313110,
    "text": "people still need to look. I used to"
  },
  {
    "startMs": 313120,
    "text": "people still need to look. I used to think the goal was to move everything"
  },
  {
    "startMs": 315189,
    "text": "think the goal was to move everything"
  },
  {
    "startMs": 315199,
    "text": "think the goal was to move everything into code. So where do we still need"
  },
  {
    "startMs": 318070,
    "text": "into code. So where do we still need"
  },
  {
    "startMs": 318080,
    "text": "into code. So where do we still need judgment? Here is our task again. The"
  },
  {
    "startMs": 321590,
    "text": "judgment? Here is our task again. The"
  },
  {
    "startMs": 321600,
    "text": "judgment? Here is our task again. The pro says the limit is 1,500. The code"
  },
  {
    "startMs": 325110,
    "text": "pro says the limit is 1,500. The code"
  },
  {
    "startMs": 325120,
    "text": "pro says the limit is 1,500. The code says a,000. The same order is fine in"
  },
  {
    "startMs": 328550,
    "text": "says a,000. The same order is fine in"
  },
  {
    "startMs": 328560,
    "text": "says a,000. The same order is fine in one place and too high in the other and"
  },
  {
    "startMs": 331909,
    "text": "one place and too high in the other and"
  },
  {
    "startMs": 331919,
    "text": "one place and too high in the other and nothing throws an error. Even a line"
  },
  {
    "startMs": 334469,
    "text": "nothing throws an error. Even a line"
  },
  {
    "startMs": 334479,
    "text": "nothing throws an error. Even a line like do not call X teaches the model"
  },
  {
    "startMs": 337670,
    "text": "like do not call X teaches the model"
  },
  {
    "startMs": 337680,
    "text": "like do not call X teaches the model that X exists. That's the third stone"
  },
  {
    "startMs": 341270,
    "text": "that X exists. That's the third stone"
  },
  {
    "startMs": 341280,
    "text": "that X exists. That's the third stone reality. Is it true or does it only look"
  },
  {
    "startMs": 344790,
    "text": "reality. Is it true or does it only look"
  },
  {
    "startMs": 344800,
    "text": "reality. Is it true or does it only look true for the model? Pros has no"
  },
  {
    "startMs": 347749,
    "text": "true for the model? Pros has no"
  },
  {
    "startMs": 347759,
    "text": "true for the model? Pros has no compiler. So we built one. Then the"
  },
  {
    "startMs": 350790,
    "text": "compiler. So we built one. Then the"
  },
  {
    "startMs": 350800,
    "text": "compiler. So we built one. Then the author lints every changed file into"
  },
  {
    "startMs": 353510,
    "text": "author lints every changed file into"
  },
  {
    "startMs": 353520,
    "text": "author lints every changed file into ledger just like code."
  },
  {
    "startMs": 358800,
    "text": "Lind can't stop copies drifting aparts."
  },
  {
    "startMs": 362070,
    "text": "Lind can't stop copies drifting aparts."
  },
  {
    "startMs": 362080,
    "text": "Lind can't stop copies drifting aparts. So we watched the walks. A walk is the"
  },
  {
    "startMs": 364629,
    "text": "So we watched the walks. A walk is the"
  },
  {
    "startMs": 364639,
    "text": "So we watched the walks. A walk is the path one agent takes through the pros."
  },
  {
    "startMs": 367909,
    "text": "path one agent takes through the pros."
  },
  {
    "startMs": 367919,
    "text": "path one agent takes through the pros. When agents keep walking in the same"
  },
  {
    "startMs": 369909,
    "text": "When agents keep walking in the same"
  },
  {
    "startMs": 369919,
    "text": "When agents keep walking in the same path, we turn it into one workflow tool"
  },
  {
    "startMs": 372870,
    "text": "path, we turn it into one workflow tool"
  },
  {
    "startMs": 372880,
    "text": "path, we turn it into one workflow tool and we delete the pros that walked it."
  },
  {
    "startMs": 376790,
    "text": "and we delete the pros that walked it."
  },
  {
    "startMs": 376800,
    "text": "and we delete the pros that walked it. Our first workflow of tools made things"
  },
  {
    "startMs": 379510,
    "text": "Our first workflow of tools made things"
  },
  {
    "startMs": 379520,
    "text": "Our first workflow of tools made things worse. The pros still named the steps"
  },
  {
    "startMs": 381990,
    "text": "worse. The pros still named the steps"
  },
  {
    "startMs": 382000,
    "text": "worse. The pros still named the steps inside them. So agents run those steps"
  },
  {
    "startMs": 385189,
    "text": "inside them. So agents run those steps"
  },
  {
    "startMs": 385199,
    "text": "inside them. So agents run those steps again. It worked once. The pros kept"
  },
  {
    "startMs": 387749,
    "text": "again. It worked once. The pros kept"
  },
  {
    "startMs": 387759,
    "text": "again. It worked once. The pros kept only the decisions. Now a walk becomes"
  },
  {
    "startMs": 391430,
    "text": "only the decisions. Now a walk becomes"
  },
  {
    "startMs": 391440,
    "text": "only the decisions. Now a walk becomes code only when it repeats and agrees"
  },
  {
    "startMs": 394710,
    "text": "code only when it repeats and agrees"
  },
  {
    "startMs": 394720,
    "text": "code only when it repeats and agrees across countries otherwise it stays"
  },
  {
    "startMs": 397510,
    "text": "across countries otherwise it stays"
  },
  {
    "startMs": 397520,
    "text": "across countries otherwise it stays pros. What still varies stays in pros"
  },
  {
    "startMs": 401590,
    "text": "pros. What still varies stays in pros"
  },
  {
    "startMs": 401600,
    "text": "pros. What still varies stays in pros inside the frame. Code prepares the"
  },
  {
    "startMs": 404070,
    "text": "inside the frame. Code prepares the"
  },
  {
    "startMs": 404080,
    "text": "inside the frame. Code prepares the facts and carries out the decision."
  },
  {
    "startMs": 407110,
    "text": "facts and carries out the decision."
  },
  {
    "startMs": 407120,
    "text": "facts and carries out the decision. Experts own the decision table and the"
  },
  {
    "startMs": 409990,
    "text": "Experts own the decision table and the"
  },
  {
    "startMs": 410000,
    "text": "Experts own the decision table and the model only picks a row. If no row fits,"
  },
  {
    "startMs": 413990,
    "text": "model only picks a row. If no row fits,"
  },
  {
    "startMs": 414000,
    "text": "model only picks a row. If no row fits, a person takes over. We haven't built"
  },
  {
    "startMs": 416710,
    "text": "a person takes over. We haven't built"
  },
  {
    "startMs": 416720,
    "text": "a person takes over. We haven't built the next step yet. The model will take"
  },
  {
    "startMs": 418950,
    "text": "the next step yet. The model will take"
  },
  {
    "startMs": 418960,
    "text": "the next step yet. The model will take the small decisions and workflows will"
  },
  {
    "startMs": 421749,
    "text": "the small decisions and workflows will"
  },
  {
    "startMs": 421759,
    "text": "the small decisions and workflows will connect them. This boundary moves both"
  },
  {
    "startMs": 424550,
    "text": "connect them. This boundary moves both"
  },
  {
    "startMs": 424560,
    "text": "connect them. This boundary moves both ways. We moved hundreds of lines of"
  },
  {
    "startMs": 427510,
    "text": "ways. We moved hundreds of lines of"
  },
  {
    "startMs": 427520,
    "text": "ways. We moved hundreds of lines of expressions out of code and into pros"
  },
  {
    "startMs": 431189,
    "text": "expressions out of code and into pros"
  },
  {
    "startMs": 431199,
    "text": "expressions out of code and into pros because experts couldn't read them. A"
  },
  {
    "startMs": 434230,
    "text": "because experts couldn't read them. A"
  },
  {
    "startMs": 434240,
    "text": "because experts couldn't read them. A reax is still fine for spotting a"
  },
  {
    "startMs": 435830,
    "text": "reax is still fine for spotting a"
  },
  {
    "startMs": 435840,
    "text": "reax is still fine for spotting a critical signal. When there are many,"
  },
  {
    "startMs": 438550,
    "text": "critical signal. When there are many,"
  },
  {
    "startMs": 438560,
    "text": "critical signal. When there are many, they move into config. Judgment stays"
  },
  {
    "startMs": 441670,
    "text": "they move into config. Judgment stays"
  },
  {
    "startMs": 441680,
    "text": "they move into config. Judgment stays wherever the answer varies in a place an"
  },
  {
    "startMs": 444870,
    "text": "wherever the answer varies in a place an"
  },
  {
    "startMs": 444880,
    "text": "wherever the answer varies in a place an expert can read. Chapter three. Now the"
  },
  {
    "startMs": 448550,
    "text": "expert can read. Chapter three. Now the"
  },
  {
    "startMs": 448560,
    "text": "expert can read. Chapter three. Now the model decides and its decision becomes"
  },
  {
    "startMs": 451029,
    "text": "model decides and its decision becomes"
  },
  {
    "startMs": 451039,
    "text": "model decides and its decision becomes an action. I used to think control meant"
  },
  {
    "startMs": 455270,
    "text": "an action. I used to think control meant"
  },
  {
    "startMs": 455280,
    "text": "an action. I used to think control meant permissions on the agent. So what does"
  },
  {
    "startMs": 457909,
    "text": "permissions on the agent. So what does"
  },
  {
    "startMs": 457919,
    "text": "permissions on the agent. So what does it mean to stay in control?"
  },
  {
    "startMs": 461189,
    "text": "it mean to stay in control?"
  },
  {
    "startMs": 461199,
    "text": "it mean to stay in control? Control starts with what the model sees."
  },
  {
    "startMs": 464629,
    "text": "Control starts with what the model sees."
  },
  {
    "startMs": 464639,
    "text": "Control starts with what the model sees. That's what the fourth stone mind. What"
  },
  {
    "startMs": 467670,
    "text": "That's what the fourth stone mind. What"
  },
  {
    "startMs": 467680,
    "text": "That's what the fourth stone mind. What does the model know? When we let it"
  },
  {
    "startMs": 469909,
    "text": "does the model know? When we let it"
  },
  {
    "startMs": 469919,
    "text": "does the model know? When we let it choose what to load, it loaded"
  },
  {
    "startMs": 472070,
    "text": "choose what to load, it loaded"
  },
  {
    "startMs": 472080,
    "text": "choose what to load, it loaded everything. Then it invented a pricing"
  },
  {
    "startMs": 475110,
    "text": "everything. Then it invented a pricing"
  },
  {
    "startMs": 475120,
    "text": "everything. Then it invented a pricing check just because prices were visible."
  },
  {
    "startMs": 478070,
    "text": "check just because prices were visible."
  },
  {
    "startMs": 478080,
    "text": "check just because prices were visible. Whatever sits in its context becomes a"
  },
  {
    "startMs": 481029,
    "text": "Whatever sits in its context becomes a"
  },
  {
    "startMs": 481039,
    "text": "Whatever sits in its context becomes a reason to act. The runtime decides"
  },
  {
    "startMs": 484629,
    "text": "reason to act. The runtime decides"
  },
  {
    "startMs": 484639,
    "text": "reason to act. The runtime decides what's the model sees for our task."
  },
  {
    "startMs": 487029,
    "text": "what's the model sees for our task."
  },
  {
    "startMs": 487039,
    "text": "what's the model sees for our task. That's three facts from the order. The"
  },
  {
    "startMs": 489909,
    "text": "That's three facts from the order. The"
  },
  {
    "startMs": 489919,
    "text": "That's three facts from the order. The full record stays with the runtime and"
  },
  {
    "startMs": 492710,
    "text": "full record stays with the runtime and"
  },
  {
    "startMs": 492720,
    "text": "full record stays with the runtime and the model makes fewer wrong moves."
  },
  {
    "startMs": 497840,
    "text": "Here how we minimize context blo for a"
  },
  {
    "startMs": 500629,
    "text": "Here how we minimize context blo for a"
  },
  {
    "startMs": 500639,
    "text": "Here how we minimize context blo for a big set. The model passes a handle, a"
  },
  {
    "startMs": 502710,
    "text": "big set. The model passes a handle, a"
  },
  {
    "startMs": 502720,
    "text": "big set. The model passes a handle, a short name for date that the runtime"
  },
  {
    "startMs": 504550,
    "text": "short name for date that the runtime"
  },
  {
    "startMs": 504560,
    "text": "short name for date that the runtime already holds. The runtime checks it"
  },
  {
    "startMs": 507430,
    "text": "already holds. The runtime checks it"
  },
  {
    "startMs": 507440,
    "text": "already holds. The runtime checks it before any write. It keeps the context"
  },
  {
    "startMs": 509749,
    "text": "before any write. It keeps the context"
  },
  {
    "startMs": 509759,
    "text": "before any write. It keeps the context small and still enough for the decision."
  },
  {
    "startMs": 512709,
    "text": "small and still enough for the decision."
  },
  {
    "startMs": 512719,
    "text": "small and still enough for the decision. At the same time, it uh validates"
  },
  {
    "startMs": 515670,
    "text": "At the same time, it uh validates"
  },
  {
    "startMs": 515680,
    "text": "At the same time, it uh validates context for consistency. A model with"
  },
  {
    "startMs": 519029,
    "text": "context for consistency. A model with"
  },
  {
    "startMs": 519039,
    "text": "context for consistency. A model with the right facts can still do damage."
  },
  {
    "startMs": 521829,
    "text": "the right facts can still do damage."
  },
  {
    "startMs": 521839,
    "text": "the right facts can still do damage. That's the fifth stone, power. What made"
  },
  {
    "startMs": 525190,
    "text": "That's the fifth stone, power. What made"
  },
  {
    "startMs": 525200,
    "text": "That's the fifth stone, power. What made change? We control a change twice."
  },
  {
    "startMs": 527910,
    "text": "change? We control a change twice."
  },
  {
    "startMs": 527920,
    "text": "change? We control a change twice. during development and again at the"
  },
  {
    "startMs": 530470,
    "text": "during development and again at the"
  },
  {
    "startMs": 530480,
    "text": "during development and again at the right at runtime only code opens the"
  },
  {
    "startMs": 533670,
    "text": "right at runtime only code opens the"
  },
  {
    "startMs": 533680,
    "text": "right at runtime only code opens the right path so we can change pros many"
  },
  {
    "startMs": 536230,
    "text": "right path so we can change pros many"
  },
  {
    "startMs": 536240,
    "text": "right path so we can change pros many times a day the open rings are the parts"
  },
  {
    "startMs": 539430,
    "text": "times a day the open rings are the parts"
  },
  {
    "startMs": 539440,
    "text": "times a day the open rings are the parts that still depend on people let's zoom"
  },
  {
    "startMs": 542790,
    "text": "that still depend on people let's zoom"
  },
  {
    "startMs": 542800,
    "text": "that still depend on people let's zoom in and run right five walls stand in"
  },
  {
    "startMs": 546150,
    "text": "in and run right five walls stand in"
  },
  {
    "startMs": 546160,
    "text": "in and run right five walls stand in front of it and the sixth checks that it"
  },
  {
    "startMs": 548949,
    "text": "front of it and the sixth checks that it"
  },
  {
    "startMs": 548959,
    "text": "front of it and the sixth checks that it landed if a right looks like it failed"
  },
  {
    "startMs": 552150,
    "text": "landed if a right looks like it failed"
  },
  {
    "startMs": 552160,
    "text": "landed if a right looks like it failed an agent retries and the journal makes"
  },
  {
    "startMs": 555110,
    "text": "an agent retries and the journal makes"
  },
  {
    "startMs": 555120,
    "text": "an agent retries and the journal makes sure it runs only once means much more"
  },
  {
    "startMs": 558310,
    "text": "sure it runs only once means much more"
  },
  {
    "startMs": 558320,
    "text": "sure it runs only once means much more than permissions on the agent."
  },
  {
    "startMs": 564000,
    "text": "Chapter 4. Most days I glide over the"
  },
  {
    "startMs": 567509,
    "text": "Chapter 4. Most days I glide over the"
  },
  {
    "startMs": 567519,
    "text": "Chapter 4. Most days I glide over the system. From up here, everything looks"
  },
  {
    "startMs": 570310,
    "text": "system. From up here, everything looks"
  },
  {
    "startMs": 570320,
    "text": "system. From up here, everything looks fine, so I don't go down into every"
  },
  {
    "startMs": 572790,
    "text": "fine, so I don't go down into every"
  },
  {
    "startMs": 572800,
    "text": "fine, so I don't go down into every change my agents made. Then the surface"
  },
  {
    "startMs": 576389,
    "text": "change my agents made. Then the surface"
  },
  {
    "startMs": 576399,
    "text": "change my agents made. Then the surface gets rough. How do we know we're losing"
  },
  {
    "startMs": 579269,
    "text": "gets rough. How do we know we're losing"
  },
  {
    "startMs": 579279,
    "text": "gets rough. How do we know we're losing control?"
  },
  {
    "startMs": 581110,
    "text": "control?"
  },
  {
    "startMs": 581120,
    "text": "control? All those controls protect the system."
  },
  {
    "startMs": 583350,
    "text": "All those controls protect the system."
  },
  {
    "startMs": 583360,
    "text": "All those controls protect the system. Nothing protected my attention. At the"
  },
  {
    "startMs": 586310,
    "text": "Nothing protected my attention. At the"
  },
  {
    "startMs": 586320,
    "text": "Nothing protected my attention. At the start, I read every change and that's"
  },
  {
    "startMs": 588949,
    "text": "start, I read every change and that's"
  },
  {
    "startMs": 588959,
    "text": "start, I read every change and that's how the system picked up my habits. Then"
  },
  {
    "startMs": 592150,
    "text": "how the system picked up my habits. Then"
  },
  {
    "startMs": 592160,
    "text": "how the system picked up my habits. Then the volume grew past what one person can"
  },
  {
    "startMs": 595590,
    "text": "the volume grew past what one person can"
  },
  {
    "startMs": 595600,
    "text": "the volume grew past what one person can read. I was burning out and I stopped"
  },
  {
    "startMs": 598230,
    "text": "read. I was burning out and I stopped"
  },
  {
    "startMs": 598240,
    "text": "read. I was burning out and I stopped reading every change. That was the price"
  },
  {
    "startMs": 600949,
    "text": "reading every change. That was the price"
  },
  {
    "startMs": 600959,
    "text": "reading every change. That was the price of the last stone. So, who judges and"
  },
  {
    "startMs": 604470,
    "text": "of the last stone. So, who judges and"
  },
  {
    "startMs": 604480,
    "text": "of the last stone. So, who judges and what does it cost? With it, the gauntlet"
  },
  {
    "startMs": 607430,
    "text": "what does it cost? With it, the gauntlet"
  },
  {
    "startMs": 607440,
    "text": "what does it cost? With it, the gauntlet is complete. Every tech lead I know has"
  },
  {
    "startMs": 610710,
    "text": "is complete. Every tech lead I know has"
  },
  {
    "startMs": 610720,
    "text": "is complete. Every tech lead I know has been here. The one person every change"
  },
  {
    "startMs": 613670,
    "text": "been here. The one person every change"
  },
  {
    "startMs": 613680,
    "text": "been here. The one person every change waits on. agents just get you there in"
  },
  {
    "startMs": 616870,
    "text": "waits on. agents just get you there in"
  },
  {
    "startMs": 616880,
    "text": "waits on. agents just get you there in weeks instead of years. I needed a way"
  },
  {
    "startMs": 619910,
    "text": "weeks instead of years. I needed a way"
  },
  {
    "startMs": 619920,
    "text": "weeks instead of years. I needed a way of working that doesn't run through one"
  },
  {
    "startMs": 622389,
    "text": "of working that doesn't run through one"
  },
  {
    "startMs": 622399,
    "text": "of working that doesn't run through one head. And the first gauge was me. When"
  },
  {
    "startMs": 625509,
    "text": "head. And the first gauge was me. When"
  },
  {
    "startMs": 625519,
    "text": "head. And the first gauge was me. When I'm tired and I can't explain what"
  },
  {
    "startMs": 627750,
    "text": "I'm tired and I can't explain what"
  },
  {
    "startMs": 627760,
    "text": "I'm tired and I can't explain what changed, that's the signal. The"
  },
  {
    "startMs": 630069,
    "text": "changed, that's the signal. The"
  },
  {
    "startMs": 630079,
    "text": "changed, that's the signal. The dashboard can be green while that gauge"
  },
  {
    "startMs": 633110,
    "text": "dashboard can be green while that gauge"
  },
  {
    "startMs": 633120,
    "text": "dashboard can be green while that gauge is firing. So, I stop and fix the"
  },
  {
    "startMs": 636230,
    "text": "is firing. So, I stop and fix the"
  },
  {
    "startMs": 636240,
    "text": "is firing. So, I stop and fix the process first. I don't wait for a"
  },
  {
    "startMs": 638630,
    "text": "process first. I don't wait for a"
  },
  {
    "startMs": 638640,
    "text": "process first. I don't wait for a number. I couldn't read every div"
  },
  {
    "startMs": 641670,
    "text": "number. I couldn't read every div"
  },
  {
    "startMs": 641680,
    "text": "number. I couldn't read every div anymore. So I built instruments that"
  },
  {
    "startMs": 643990,
    "text": "anymore. So I built instruments that"
  },
  {
    "startMs": 644000,
    "text": "anymore. So I built instruments that watch how things change and their"
  },
  {
    "startMs": 646550,
    "text": "watch how things change and their"
  },
  {
    "startMs": 646560,
    "text": "watch how things change and their derivatives. One of them is blast"
  },
  {
    "startMs": 649509,
    "text": "derivatives. One of them is blast"
  },
  {
    "startMs": 649519,
    "text": "derivatives. One of them is blast radius. Before we built one new check,"
  },
  {
    "startMs": 652389,
    "text": "radius. Before we built one new check,"
  },
  {
    "startMs": 652399,
    "text": "radius. Before we built one new check, we replayed its rule over several"
  },
  {
    "startMs": 654550,
    "text": "we replayed its rule over several"
  },
  {
    "startMs": 654560,
    "text": "we replayed its rule over several thousand past sessions. It would have"
  },
  {
    "startMs": 656949,
    "text": "thousand past sessions. It would have"
  },
  {
    "startMs": 656959,
    "text": "thousand past sessions. It would have fired on less than 1%. Where the numbers"
  },
  {
    "startMs": 660310,
    "text": "fired on less than 1%. Where the numbers"
  },
  {
    "startMs": 660320,
    "text": "fired on less than 1%. Where the numbers jump, I go down and read. When something"
  },
  {
    "startMs": 664150,
    "text": "jump, I go down and read. When something"
  },
  {
    "startMs": 664160,
    "text": "jump, I go down and read. When something looks wrong, we wait. One signal waits"
  },
  {
    "startMs": 666870,
    "text": "looks wrong, we wait. One signal waits"
  },
  {
    "startMs": 666880,
    "text": "looks wrong, we wait. One signal waits until it comes back, even when it comes"
  },
  {
    "startMs": 669350,
    "text": "until it comes back, even when it comes"
  },
  {
    "startMs": 669360,
    "text": "until it comes back, even when it comes from an expert. A cluster across slices"
  },
  {
    "startMs": 672630,
    "text": "from an expert. A cluster across slices"
  },
  {
    "startMs": 672640,
    "text": "from an expert. A cluster across slices is different. Then we fix the concept"
  },
  {
    "startMs": 675430,
    "text": "is different. Then we fix the concept"
  },
  {
    "startMs": 675440,
    "text": "is different. Then we fix the concept behind it once. Left alone, an agent"
  },
  {
    "startMs": 678470,
    "text": "behind it once. Left alone, an agent"
  },
  {
    "startMs": 678480,
    "text": "behind it once. Left alone, an agent keeps adding conditions until today's"
  },
  {
    "startMs": 680710,
    "text": "keeps adding conditions until today's"
  },
  {
    "startMs": 680720,
    "text": "keeps adding conditions until today's tasks pass. The eval score drops when"
  },
  {
    "startMs": 683829,
    "text": "tasks pass. The eval score drops when"
  },
  {
    "startMs": 683839,
    "text": "tasks pass. The eval score drops when you take them out and you get an honest"
  },
  {
    "startMs": 686230,
    "text": "you take them out and you get an honest"
  },
  {
    "startMs": 686240,
    "text": "you take them out and you get an honest list of gaps."
  },
  {
    "startMs": 691120,
    "text": "One red slice is rarely alone. The"
  },
  {
    "startMs": 694069,
    "text": "One red slice is rarely alone. The"
  },
  {
    "startMs": 694079,
    "text": "One red slice is rarely alone. The experts note becomes an eval and an"
  },
  {
    "startMs": 696870,
    "text": "experts note becomes an eval and an"
  },
  {
    "startMs": 696880,
    "text": "experts note becomes an eval and an agent searches the siblings for the same"
  },
  {
    "startMs": 699110,
    "text": "agent searches the siblings for the same"
  },
  {
    "startMs": 699120,
    "text": "agent searches the siblings for the same failure. Siblings differ on purpose by"
  },
  {
    "startMs": 702389,
    "text": "failure. Siblings differ on purpose by"
  },
  {
    "startMs": 702399,
    "text": "failure. Siblings differ on purpose by market and by local law. So we sweep"
  },
  {
    "startMs": 705670,
    "text": "market and by local law. So we sweep"
  },
  {
    "startMs": 705680,
    "text": "market and by local law. So we sweep them and the fix goes only where the"
  },
  {
    "startMs": 708470,
    "text": "them and the fix goes only where the"
  },
  {
    "startMs": 708480,
    "text": "them and the fix goes only where the failure is confirmed."
  },
  {
    "startMs": 713839,
    "text": "At any time 10 to 20 of these loops are"
  },
  {
    "startMs": 717110,
    "text": "At any time 10 to 20 of these loops are"
  },
  {
    "startMs": 717120,
    "text": "At any time 10 to 20 of these loops are open. At one point I had become the"
  },
  {
    "startMs": 719750,
    "text": "open. At one point I had become the"
  },
  {
    "startMs": 719760,
    "text": "open. At one point I had become the message bus between users and my agents."
  },
  {
    "startMs": 723110,
    "text": "message bus between users and my agents."
  },
  {
    "startMs": 723120,
    "text": "message bus between users and my agents. At this scale, every user has to be an"
  },
  {
    "startMs": 726069,
    "text": "At this scale, every user has to be an"
  },
  {
    "startMs": 726079,
    "text": "At this scale, every user has to be an evaluator with a screen to give feedback"
  },
  {
    "startMs": 728949,
    "text": "evaluator with a screen to give feedback"
  },
  {
    "startMs": 728959,
    "text": "evaluator with a screen to give feedback without me. My job as the architect is"
  },
  {
    "startMs": 732310,
    "text": "without me. My job as the architect is"
  },
  {
    "startMs": 732320,
    "text": "without me. My job as the architect is to build those loops into the system."
  },
  {
    "startMs": 735110,
    "text": "to build those loops into the system."
  },
  {
    "startMs": 735120,
    "text": "to build those loops into the system. Each loop writes to a ledger. So nothing"
  },
  {
    "startMs": 737990,
    "text": "Each loop writes to a ledger. So nothing"
  },
  {
    "startMs": 738000,
    "text": "Each loop writes to a ledger. So nothing waits on my memory and nothing waits on"
  },
  {
    "startMs": 740949,
    "text": "waits on my memory and nothing waits on"
  },
  {
    "startMs": 740959,
    "text": "waits on my memory and nothing waits on me."
  },
  {
    "startMs": 744160,
    "text": "Agents forget everything when a session"
  },
  {
    "startMs": 746629,
    "text": "Agents forget everything when a session"
  },
  {
    "startMs": 746639,
    "text": "Agents forget everything when a session ends. So the memory has to leave in"
  },
  {
    "startMs": 749430,
    "text": "ends. So the memory has to leave in"
  },
  {
    "startMs": 749440,
    "text": "ends. So the memory has to leave in files. We keep two kinds. what happened"
  },
  {
    "startMs": 752790,
    "text": "files. We keep two kinds. what happened"
  },
  {
    "startMs": 752800,
    "text": "files. We keep two kinds. what happened and what is true now. The next session"
  },
  {
    "startMs": 755750,
    "text": "and what is true now. The next session"
  },
  {
    "startMs": 755760,
    "text": "and what is true now. The next session starts from what is true now."
  },
  {
    "startMs": 760880,
    "text": "Every issue has to connect to its root"
  },
  {
    "startMs": 763829,
    "text": "Every issue has to connect to its root"
  },
  {
    "startMs": 763839,
    "text": "Every issue has to connect to its root cause. Without that, the agent decides"
  },
  {
    "startMs": 766389,
    "text": "cause. Without that, the agent decides"
  },
  {
    "startMs": 766399,
    "text": "cause. Without that, the agent decides on wrong facts and the check has nothing"
  },
  {
    "startMs": 769110,
    "text": "on wrong facts and the check has nothing"
  },
  {
    "startMs": 769120,
    "text": "on wrong facts and the check has nothing to count. So we don't act without"
  },
  {
    "startMs": 771590,
    "text": "to count. So we don't act without"
  },
  {
    "startMs": 771600,
    "text": "to count. So we don't act without evidence."
  },
  {
    "startMs": 774310,
    "text": "evidence."
  },
  {
    "startMs": 774320,
    "text": "evidence. Reality comes back. In chapter two, it"
  },
  {
    "startMs": 778389,
    "text": "Reality comes back. In chapter two, it"
  },
  {
    "startMs": 778399,
    "text": "Reality comes back. In chapter two, it asked if the pros is true. Now it asks"
  },
  {
    "startMs": 781590,
    "text": "asked if the pros is true. Now it asks"
  },
  {
    "startMs": 781600,
    "text": "asked if the pros is true. Now it asks if the change is I used to trust green."
  },
  {
    "startMs": 785509,
    "text": "if the change is I used to trust green."
  },
  {
    "startMs": 785519,
    "text": "if the change is I used to trust green. So what would make us change our mind?"
  },
  {
    "startMs": 788949,
    "text": "So what would make us change our mind?"
  },
  {
    "startMs": 788959,
    "text": "So what would make us change our mind? Green was tempting because checking is"
  },
  {
    "startMs": 791350,
    "text": "Green was tempting because checking is"
  },
  {
    "startMs": 791360,
    "text": "Green was tempting because checking is where the times goes. My agent spend"
  },
  {
    "startMs": 793990,
    "text": "where the times goes. My agent spend"
  },
  {
    "startMs": 794000,
    "text": "where the times goes. My agent spend almost 9/10en of that time on a change"
  },
  {
    "startMs": 797269,
    "text": "almost 9/10en of that time on a change"
  },
  {
    "startMs": 797279,
    "text": "almost 9/10en of that time on a change just checking it and checking took a"
  },
  {
    "startMs": 799670,
    "text": "just checking it and checking took a"
  },
  {
    "startMs": 799680,
    "text": "just checking it and checking took a bigger share of my own week too."
  },
  {
    "startMs": 802150,
    "text": "bigger share of my own week too."
  },
  {
    "startMs": 802160,
    "text": "bigger share of my own week too. Verification speed is the limit."
  },
  {
    "startMs": 807680,
    "text": "We rank evidence by what it proves. A"
  },
  {
    "startMs": 810870,
    "text": "We rank evidence by what it proves. A"
  },
  {
    "startMs": 810880,
    "text": "We rank evidence by what it proves. A replay on real tasks sits at the top."
  },
  {
    "startMs": 813990,
    "text": "replay on real tasks sits at the top."
  },
  {
    "startMs": 814000,
    "text": "replay on real tasks sits at the top. Before the data arrives, we write down"
  },
  {
    "startMs": 816710,
    "text": "Before the data arrives, we write down"
  },
  {
    "startMs": 816720,
    "text": "Before the data arrives, we write down what would prove us wrong. And every new"
  },
  {
    "startMs": 819190,
    "text": "what would prove us wrong. And every new"
  },
  {
    "startMs": 819200,
    "text": "what would prove us wrong. And every new check has to fail once on purpose before"
  },
  {
    "startMs": 821990,
    "text": "check has to fail once on purpose before"
  },
  {
    "startMs": 822000,
    "text": "check has to fail once on purpose before we trust it."
  },
  {
    "startMs": 826639,
    "text": "AI refactors fail quietly. Every"
  },
  {
    "startMs": 830150,
    "text": "AI refactors fail quietly. Every"
  },
  {
    "startMs": 830160,
    "text": "AI refactors fail quietly. Every condition and every decision table row"
  },
  {
    "startMs": 833190,
    "text": "condition and every decision table row"
  },
  {
    "startMs": 833200,
    "text": "condition and every decision table row is a branch. And after a refactor, each"
  },
  {
    "startMs": 836150,
    "text": "is a branch. And after a refactor, each"
  },
  {
    "startMs": 836160,
    "text": "is a branch. And after a refactor, each one has to land exactly once. Here the"
  },
  {
    "startMs": 839430,
    "text": "one has to land exactly once. Here the"
  },
  {
    "startMs": 839440,
    "text": "one has to land exactly once. Here the branch for amounts over the limit got"
  },
  {
    "startMs": 841590,
    "text": "branch for amounts over the limit got"
  },
  {
    "startMs": 841600,
    "text": "branch for amounts over the limit got lost. Our [snorts] order would have gone"
  },
  {
    "startMs": 844550,
    "text": "lost. Our [snorts] order would have gone"
  },
  {
    "startMs": 844560,
    "text": "lost. Our [snorts] order would have gone through without the team lead. Real"
  },
  {
    "startMs": 847910,
    "text": "through without the team lead. Real"
  },
  {
    "startMs": 847920,
    "text": "through without the team lead. Real tasks decide what we test. We freeze"
  },
  {
    "startMs": 851350,
    "text": "tasks decide what we test. We freeze"
  },
  {
    "startMs": 851360,
    "text": "tasks decide what we test. We freeze them as a set and replay the old version"
  },
  {
    "startMs": 854470,
    "text": "them as a set and replay the old version"
  },
  {
    "startMs": 854480,
    "text": "them as a set and replay the old version against the new one. If no real task"
  },
  {
    "startMs": 857189,
    "text": "against the new one. If no real task"
  },
  {
    "startMs": 857199,
    "text": "against the new one. If no real task takes a branch, we call that no"
  },
  {
    "startMs": 859829,
    "text": "takes a branch, we call that no"
  },
  {
    "startMs": 859839,
    "text": "takes a branch, we call that no evidence."
  },
  {
    "startMs": 861430,
    "text": "evidence."
  },
  {
    "startMs": 861440,
    "text": "evidence. You can't trust one agent to judge its"
  },
  {
    "startMs": 864310,
    "text": "You can't trust one agent to judge its"
  },
  {
    "startMs": 864320,
    "text": "You can't trust one agent to judge its own work. A second agent checks it with"
  },
  {
    "startMs": 867990,
    "text": "own work. A second agent checks it with"
  },
  {
    "startMs": 868000,
    "text": "own work. A second agent checks it with a checklist and without the author's"
  },
  {
    "startMs": 870629,
    "text": "a checklist and without the author's"
  },
  {
    "startMs": 870639,
    "text": "a checklist and without the author's reasoning. It can't be talked into"
  },
  {
    "startMs": 872870,
    "text": "reasoning. It can't be talked into"
  },
  {
    "startMs": 872880,
    "text": "reasoning. It can't be talked into agreeing. Over 6 months, it grew to most"
  },
  {
    "startMs": 876470,
    "text": "agreeing. Over 6 months, it grew to most"
  },
  {
    "startMs": 876480,
    "text": "agreeing. Over 6 months, it grew to most of my checking."
  },
  {
    "startMs": 879829,
    "text": "of my checking."
  },
  {
    "startMs": 879839,
    "text": "of my checking. Coding agents finish most of a batch and"
  },
  {
    "startMs": 883030,
    "text": "Coding agents finish most of a batch and"
  },
  {
    "startMs": 883040,
    "text": "Coding agents finish most of a batch and quietly skipped the rest, especially"
  },
  {
    "startMs": 885189,
    "text": "quietly skipped the rest, especially"
  },
  {
    "startMs": 885199,
    "text": "quietly skipped the rest, especially when their context is full. The ledger"
  },
  {
    "startMs": 888150,
    "text": "when their context is full. The ledger"
  },
  {
    "startMs": 888160,
    "text": "when their context is full. The ledger shows what was skipped in one backlog."
  },
  {
    "startMs": 891590,
    "text": "shows what was skipped in one backlog."
  },
  {
    "startMs": 891600,
    "text": "shows what was skipped in one backlog. Most items looks covered, but only about"
  },
  {
    "startMs": 894550,
    "text": "Most items looks covered, but only about"
  },
  {
    "startMs": 894560,
    "text": "Most items looks covered, but only about a quarter could really be closed. So now"
  },
  {
    "startMs": 898389,
    "text": "a quarter could really be closed. So now"
  },
  {
    "startMs": 898399,
    "text": "a quarter could really be closed. So now evidence we can count is what changes"
  },
  {
    "startMs": 901750,
    "text": "evidence we can count is what changes"
  },
  {
    "startMs": 901760,
    "text": "evidence we can count is what changes our mind. And this is the third option"
  },
  {
    "startMs": 905910,
    "text": "our mind. And this is the third option"
  },
  {
    "startMs": 905920,
    "text": "our mind. And this is the third option from the start of the talk. I used to"
  },
  {
    "startMs": 908389,
    "text": "from the start of the talk. I used to"
  },
  {
    "startMs": 908399,
    "text": "from the start of the talk. I used to think there were two choices. Keep"
  },
  {
    "startMs": 911030,
    "text": "think there were two choices. Keep"
  },
  {
    "startMs": 911040,
    "text": "think there were two choices. Keep everything or snap. So what is worth"
  },
  {
    "startMs": 914710,
    "text": "everything or snap. So what is worth"
  },
  {
    "startMs": 914720,
    "text": "everything or snap. So what is worth carrying forward?"
  },
  {
    "startMs": 916870,
    "text": "carrying forward?"
  },
  {
    "startMs": 916880,
    "text": "carrying forward? This one process over a year. Some"
  },
  {
    "startMs": 919670,
    "text": "This one process over a year. Some"
  },
  {
    "startMs": 919680,
    "text": "This one process over a year. Some branches merged back, some still drift,"
  },
  {
    "startMs": 922870,
    "text": "branches merged back, some still drift,"
  },
  {
    "startMs": 922880,
    "text": "branches merged back, some still drift, and some are dead but still look alive."
  },
  {
    "startMs": 925910,
    "text": "and some are dead but still look alive."
  },
  {
    "startMs": 925920,
    "text": "and some are dead but still look alive. Which ones deserve to survive?"
  },
  {
    "startMs": 930720,
    "text": "A fix is only a moment. These forces"
  },
  {
    "startMs": 933910,
    "text": "A fix is only a moment. These forces"
  },
  {
    "startMs": 933920,
    "text": "A fix is only a moment. These forces keep pushing right after it. You've met"
  },
  {
    "startMs": 936949,
    "text": "keep pushing right after it. You've met"
  },
  {
    "startMs": 936959,
    "text": "keep pushing right after it. You've met most of them already. This chapter deals"
  },
  {
    "startMs": 939829,
    "text": "most of them already. This chapter deals"
  },
  {
    "startMs": 939839,
    "text": "most of them already. This chapter deals with regrowth and branching."
  },
  {
    "startMs": 944560,
    "text": "The first gauge was me back in chapter"
  },
  {
    "startMs": 946870,
    "text": "The first gauge was me back in chapter"
  },
  {
    "startMs": 946880,
    "text": "The first gauge was me back in chapter 4. These are the gauges for the code."
  },
  {
    "startMs": 950629,
    "text": "4. These are the gauges for the code."
  },
  {
    "startMs": 950639,
    "text": "4. These are the gauges for the code. Time gets its answers here. The bridge"
  },
  {
    "startMs": 953110,
    "text": "Time gets its answers here. The bridge"
  },
  {
    "startMs": 953120,
    "text": "Time gets its answers here. The bridge line comes back as a number. A ratchet"
  },
  {
    "startMs": 956150,
    "text": "line comes back as a number. A ratchet"
  },
  {
    "startMs": 956160,
    "text": "line comes back as a number. A ratchet means the count can only go down. Two"
  },
  {
    "startMs": 958790,
    "text": "means the count can only go down. Two"
  },
  {
    "startMs": 958800,
    "text": "means the count can only go down. Two gauges run today and six more are next."
  },
  {
    "startMs": 964150,
    "text": "gauges run today and six more are next."
  },
  {
    "startMs": 964160,
    "text": "gauges run today and six more are next. Every week real use decides what stays."
  },
  {
    "startMs": 967670,
    "text": "Every week real use decides what stays."
  },
  {
    "startMs": 967680,
    "text": "Every week real use decides what stays. Anything no real task reaches gets a"
  },
  {
    "startMs": 970550,
    "text": "Anything no real task reaches gets a"
  },
  {
    "startMs": 970560,
    "text": "Anything no real task reaches gets a name and its evidence before it goes."
  },
  {
    "startMs": 973829,
    "text": "name and its evidence before it goes."
  },
  {
    "startMs": 973839,
    "text": "name and its evidence before it goes. Test the evidence I didn't have when I"
  },
  {
    "startMs": 976629,
    "text": "Test the evidence I didn't have when I"
  },
  {
    "startMs": 976639,
    "text": "Test the evidence I didn't have when I snapped. Tests kept that variants alive."
  },
  {
    "startMs": 980470,
    "text": "snapped. Tests kept that variants alive."
  },
  {
    "startMs": 980480,
    "text": "snapped. Tests kept that variants alive. Agents kept every option a test still"
  },
  {
    "startMs": 983350,
    "text": "Agents kept every option a test still"
  },
  {
    "startMs": 983360,
    "text": "Agents kept every option a test still mentioned. Now retired variant takes its"
  },
  {
    "startMs": 987030,
    "text": "mentioned. Now retired variant takes its"
  },
  {
    "startMs": 987040,
    "text": "mentioned. Now retired variant takes its test with it. Here's the whole method as"
  },
  {
    "startMs": 990790,
    "text": "test with it. Here's the whole method as"
  },
  {
    "startMs": 990800,
    "text": "test with it. Here's the whole method as one week. This is the third option as a"
  },
  {
    "startMs": 994629,
    "text": "one week. This is the third option as a"
  },
  {
    "startMs": 994639,
    "text": "one week. This is the third option as a process."
  },
  {
    "startMs": 999199,
    "text": "together. That's the full gauntlet."
  },
  {
    "startMs": 1002230,
    "text": "together. That's the full gauntlet."
  },
  {
    "startMs": 1002240,
    "text": "together. That's the full gauntlet. Thanos used his for one snap. We use"
  },
  {
    "startMs": 1005430,
    "text": "Thanos used his for one snap. We use"
  },
  {
    "startMs": 1005440,
    "text": "Thanos used his for one snap. We use ours every week in small doses with"
  },
  {
    "startMs": 1008470,
    "text": "ours every week in small doses with"
  },
  {
    "startMs": 1008480,
    "text": "ours every week in small doses with evidence. I haven't had to snap again."
  },
  {
    "startMs": 1015839,
    "text": "Soul had a second price and I only saw"
  },
  {
    "startMs": 1018870,
    "text": "Soul had a second price and I only saw"
  },
  {
    "startMs": 1018880,
    "text": "Soul had a second price and I only saw it later. After we deliver it to"
  },
  {
    "startMs": 1021110,
    "text": "it later. After we deliver it to"
  },
  {
    "startMs": 1021120,
    "text": "it later. After we deliver it to production, I found my own engineering"
  },
  {
    "startMs": 1023829,
    "text": "production, I found my own engineering"
  },
  {
    "startMs": 1023839,
    "text": "production, I found my own engineering principles built into the systems"
  },
  {
    "startMs": 1026150,
    "text": "principles built into the systems"
  },
  {
    "startMs": 1026160,
    "text": "principles built into the systems design. Its skills and its memory carry"
  },
  {
    "startMs": 1029350,
    "text": "design. Its skills and its memory carry"
  },
  {
    "startMs": 1029360,
    "text": "design. Its skills and its memory carry my habits and my biases. Conway said the"
  },
  {
    "startMs": 1032949,
    "text": "my habits and my biases. Conway said the"
  },
  {
    "startMs": 1032959,
    "text": "my habits and my biases. Conway said the system copies the orc chart. Ours copies"
  },
  {
    "startMs": 1036390,
    "text": "system copies the orc chart. Ours copies"
  },
  {
    "startMs": 1036400,
    "text": "system copies the orc chart. Ours copies whoever corrects it. Here are 18"
  },
  {
    "startMs": 1039909,
    "text": "whoever corrects it. Here are 18"
  },
  {
    "startMs": 1039919,
    "text": "whoever corrects it. Here are 18 questions, three for each stone. I'm"
  },
  {
    "startMs": 1042949,
    "text": "questions, three for each stone. I'm"
  },
  {
    "startMs": 1042959,
    "text": "questions, three for each stone. I'm using them when working on my projects."
  },
  {
    "startMs": 1046470,
    "text": "using them when working on my projects."
  },
  {
    "startMs": 1046480,
    "text": "using them when working on my projects. Pause here and pick one your own"
  },
  {
    "startMs": 1049110,
    "text": "Pause here and pick one your own"
  },
  {
    "startMs": 1049120,
    "text": "Pause here and pick one your own repository can't answer yet. That's"
  },
  {
    "startMs": 1052710,
    "text": "repository can't answer yet. That's"
  },
  {
    "startMs": 1052720,
    "text": "repository can't answer yet. That's where to start."
  },
  {
    "startMs": 1057760,
    "text": "I learned to use this process when I was"
  },
  {
    "startMs": 1060549,
    "text": "I learned to use this process when I was"
  },
  {
    "startMs": 1060559,
    "text": "I learned to use this process when I was already burning out. If you're the one"
  },
  {
    "startMs": 1063270,
    "text": "already burning out. If you're the one"
  },
  {
    "startMs": 1063280,
    "text": "already burning out. If you're the one your team's changes weight on today,"
  },
  {
    "startMs": 1066230,
    "text": "your team's changes weight on today,"
  },
  {
    "startMs": 1066240,
    "text": "your team's changes weight on today, this is for you. Use your stones while"
  },
  {
    "startMs": 1069190,
    "text": "this is for you. Use your stones while"
  },
  {
    "startMs": 1069200,
    "text": "this is for you. Use your stones while you can still read every change. In the"
  },
  {
    "startMs": 1072230,
    "text": "you can still read every change. In the"
  },
  {
    "startMs": 1072240,
    "text": "you can still read every change. In the end, Thanos retires to a garden. Maybe"
  },
  {
    "startMs": 1075350,
    "text": "end, Thanos retires to a garden. Maybe"
  },
  {
    "startMs": 1075360,
    "text": "end, Thanos retires to a garden. Maybe he should start using them daily. Thank"
  },
  {
    "startMs": 1079350,
    "text": "he should start using them daily. Thank"
  },
  {
    "startMs": 1079360,
    "text": "he should start using them daily. Thank you."
  }
]