[
  {
    "startMs": 0,
    "text": "Picture a pull request. It changes a"
  },
  {
    "startMs": 3270,
    "text": "Picture a pull request. It changes a"
  },
  {
    "startMs": 3280,
    "text": "Picture a pull request. It changes a schema in one of our data pipelines. It"
  },
  {
    "startMs": 5990,
    "text": "schema in one of our data pipelines. It"
  },
  {
    "startMs": 6000,
    "text": "schema in one of our data pipelines. It goes green in CI. The tests pass. The"
  },
  {
    "startMs": 8950,
    "text": "goes green in CI. The tests pass. The"
  },
  {
    "startMs": 8960,
    "text": "goes green in CI. The tests pass. The linder is happy. And everything about it"
  },
  {
    "startMs": 11350,
    "text": "linder is happy. And everything about it"
  },
  {
    "startMs": 11360,
    "text": "linder is happy. And everything about it looks clean. So, is it safe to merge?"
  },
  {
    "startMs": 15270,
    "text": "looks clean. So, is it safe to merge?"
  },
  {
    "startMs": 15280,
    "text": "looks clean. So, is it safe to merge? Because a change like this can still"
  },
  {
    "startMs": 17189,
    "text": "Because a change like this can still"
  },
  {
    "startMs": 17199,
    "text": "Because a change like this can still break something downstream. Maybe it"
  },
  {
    "startMs": 19510,
    "text": "break something downstream. Maybe it"
  },
  {
    "startMs": 19520,
    "text": "break something downstream. Maybe it blows a freshness SLA. Or maybe it"
  },
  {
    "startMs": 22070,
    "text": "blows a freshness SLA. Or maybe it"
  },
  {
    "startMs": 22080,
    "text": "blows a freshness SLA. Or maybe it breaks a consumer three teams away who"
  },
  {
    "startMs": 24070,
    "text": "breaks a consumer three teams away who"
  },
  {
    "startMs": 24080,
    "text": "breaks a consumer three teams away who never saw it coming. Or maybe it exposes"
  },
  {
    "startMs": 26870,
    "text": "never saw it coming. Or maybe it exposes"
  },
  {
    "startMs": 26880,
    "text": "never saw it coming. Or maybe it exposes data that never supposed to be"
  },
  {
    "startMs": 28390,
    "text": "data that never supposed to be"
  },
  {
    "startMs": 28400,
    "text": "data that never supposed to be reachable. That gap between CI past and"
  },
  {
    "startMs": 32630,
    "text": "reachable. That gap between CI past and"
  },
  {
    "startMs": 32640,
    "text": "reachable. That gap between CI past and this change was actually safe is the gap"
  },
  {
    "startMs": 34950,
    "text": "this change was actually safe is the gap"
  },
  {
    "startMs": 34960,
    "text": "this change was actually safe is the gap my team has to close every day. Hello"
  },
  {
    "startMs": 38229,
    "text": "my team has to close every day. Hello"
  },
  {
    "startMs": 38239,
    "text": "my team has to close every day. Hello everyone, I'm Jas. I'm an engineer on"
  },
  {
    "startMs": 40790,
    "text": "everyone, I'm Jas. I'm an engineer on"
  },
  {
    "startMs": 40800,
    "text": "everyone, I'm Jas. I'm an engineer on the data platform team at Robin Hood. I"
  },
  {
    "startMs": 43190,
    "text": "the data platform team at Robin Hood. I"
  },
  {
    "startMs": 43200,
    "text": "the data platform team at Robin Hood. I design and build the distributed data"
  },
  {
    "startMs": 45350,
    "text": "design and build the distributed data"
  },
  {
    "startMs": 45360,
    "text": "design and build the distributed data injection and processing frameworks"
  },
  {
    "startMs": 46790,
    "text": "injection and processing frameworks"
  },
  {
    "startMs": 46800,
    "text": "injection and processing frameworks behind our data lake. The ones teams"
  },
  {
    "startMs": 49830,
    "text": "behind our data lake. The ones teams"
  },
  {
    "startMs": 49840,
    "text": "behind our data lake. The ones teams across the company rely on to make"
  },
  {
    "startMs": 51750,
    "text": "across the company rely on to make"
  },
  {
    "startMs": 51760,
    "text": "across the company rely on to make decisions with data."
  },
  {
    "startMs": 53990,
    "text": "decisions with data."
  },
  {
    "startMs": 54000,
    "text": "decisions with data. Notice the title of this talk. The bots"
  },
  {
    "startMs": 56630,
    "text": "Notice the title of this talk. The bots"
  },
  {
    "startMs": 56640,
    "text": "Notice the title of this talk. The bots in it are the ones opening the pull"
  },
  {
    "startMs": 58549,
    "text": "in it are the ones opening the pull"
  },
  {
    "startMs": 58559,
    "text": "in it are the ones opening the pull requests and as you will see the ones"
  },
  {
    "startMs": 61830,
    "text": "requests and as you will see the ones"
  },
  {
    "startMs": 61840,
    "text": "requests and as you will see the ones reviewing them as well."
  },
  {
    "startMs": 64549,
    "text": "reviewing them as well."
  },
  {
    "startMs": 64559,
    "text": "reviewing them as well. Today I want to show you how we answer"
  },
  {
    "startMs": 66469,
    "text": "Today I want to show you how we answer"
  },
  {
    "startMs": 66479,
    "text": "Today I want to show you how we answer that question when the PRs are coming in"
  },
  {
    "startMs": 68950,
    "text": "that question when the PRs are coming in"
  },
  {
    "startMs": 68960,
    "text": "that question when the PRs are coming in faster than any of us can read them."
  },
  {
    "startMs": 74000,
    "text": "So here's the problem in one sentence."
  },
  {
    "startMs": 76870,
    "text": "So here's the problem in one sentence."
  },
  {
    "startMs": 76880,
    "text": "So here's the problem in one sentence. Pull requests to our production data"
  },
  {
    "startMs": 78950,
    "text": "Pull requests to our production data"
  },
  {
    "startMs": 78960,
    "text": "Pull requests to our production data pipelines now arrive at machine speed."
  },
  {
    "startMs": 81910,
    "text": "pipelines now arrive at machine speed."
  },
  {
    "startMs": 81920,
    "text": "pipelines now arrive at machine speed. But reviewing them safely still runs at"
  },
  {
    "startMs": 84230,
    "text": "But reviewing them safely still runs at"
  },
  {
    "startMs": 84240,
    "text": "But reviewing them safely still runs at human speed."
  },
  {
    "startMs": 86310,
    "text": "human speed."
  },
  {
    "startMs": 86320,
    "text": "human speed. First, a quick word on the scope of this"
  },
  {
    "startMs": 88469,
    "text": "First, a quick word on the scope of this"
  },
  {
    "startMs": 88479,
    "text": "First, a quick word on the scope of this talk because it shapes everything else"
  },
  {
    "startMs": 90630,
    "text": "talk because it shapes everything else"
  },
  {
    "startMs": 90640,
    "text": "talk because it shapes everything else in this talk."
  },
  {
    "startMs": 92789,
    "text": "in this talk."
  },
  {
    "startMs": 92799,
    "text": "in this talk. AI coding assistants have made pull"
  },
  {
    "startMs": 94710,
    "text": "AI coding assistants have made pull"
  },
  {
    "startMs": 94720,
    "text": "AI coding assistants have made pull requests cheap to open. A new query, a"
  },
  {
    "startMs": 98230,
    "text": "requests cheap to open. A new query, a"
  },
  {
    "startMs": 98240,
    "text": "requests cheap to open. A new query, a schema change, or an access grant now"
  },
  {
    "startMs": 100789,
    "text": "schema change, or an access grant now"
  },
  {
    "startMs": 100799,
    "text": "schema change, or an access grant now takes just a few minutes. And an"
  },
  {
    "startMs": 103510,
    "text": "takes just a few minutes. And an"
  },
  {
    "startMs": 103520,
    "text": "takes just a few minutes. And an assistant can open pull requests far"
  },
  {
    "startMs": 105910,
    "text": "assistant can open pull requests far"
  },
  {
    "startMs": 105920,
    "text": "assistant can open pull requests far faster than any team of humans ever"
  },
  {
    "startMs": 108310,
    "text": "faster than any team of humans ever"
  },
  {
    "startMs": 108320,
    "text": "faster than any team of humans ever could."
  },
  {
    "startMs": 110469,
    "text": "could."
  },
  {
    "startMs": 110479,
    "text": "could. The PRs I'm talking about today are the"
  },
  {
    "startMs": 112389,
    "text": "The PRs I'm talking about today are the"
  },
  {
    "startMs": 112399,
    "text": "The PRs I'm talking about today are the PRs to our data pipelines like schema"
  },
  {
    "startMs": 115109,
    "text": "PRs to our data pipelines like schema"
  },
  {
    "startMs": 115119,
    "text": "PRs to our data pipelines like schema changes, pipeline code, configuration"
  },
  {
    "startMs": 118310,
    "text": "changes, pipeline code, configuration"
  },
  {
    "startMs": 118320,
    "text": "changes, pipeline code, configuration changes, and grants that give someone"
  },
  {
    "startMs": 120630,
    "text": "changes, and grants that give someone"
  },
  {
    "startMs": 120640,
    "text": "changes, and grants that give someone access to data."
  },
  {
    "startMs": 123270,
    "text": "access to data."
  },
  {
    "startMs": 123280,
    "text": "access to data. Data platform is the team that owns"
  },
  {
    "startMs": 125109,
    "text": "Data platform is the team that owns"
  },
  {
    "startMs": 125119,
    "text": "Data platform is the team that owns reviewing that kind of PR. So when those"
  },
  {
    "startMs": 127510,
    "text": "reviewing that kind of PR. So when those"
  },
  {
    "startMs": 127520,
    "text": "reviewing that kind of PR. So when those PRs pile up, they pile up on us. And the"
  },
  {
    "startMs": 130869,
    "text": "PRs pile up, they pile up on us. And the"
  },
  {
    "startMs": 130879,
    "text": "PRs pile up, they pile up on us. And the reviewer I'm about to describe is the"
  },
  {
    "startMs": 132790,
    "text": "reviewer I'm about to describe is the"
  },
  {
    "startMs": 132800,
    "text": "reviewer I'm about to describe is the system we built to handle them."
  },
  {
    "startMs": 135430,
    "text": "system we built to handle them."
  },
  {
    "startMs": 135440,
    "text": "system we built to handle them. So the people who feel this are a small"
  },
  {
    "startMs": 137589,
    "text": "So the people who feel this are a small"
  },
  {
    "startMs": 137599,
    "text": "So the people who feel this are a small group. The engineers who carry the"
  },
  {
    "startMs": 139830,
    "text": "group. The engineers who carry the"
  },
  {
    "startMs": 139840,
    "text": "group. The engineers who carry the context to say what is safe to merge"
  },
  {
    "startMs": 142229,
    "text": "context to say what is safe to merge"
  },
  {
    "startMs": 142239,
    "text": "context to say what is safe to merge into production and everyone who is"
  },
  {
    "startMs": 144150,
    "text": "into production and everyone who is"
  },
  {
    "startMs": 144160,
    "text": "into production and everyone who is waiting on them."
  },
  {
    "startMs": 147760,
    "text": "So why is this a problem?"
  },
  {
    "startMs": 150790,
    "text": "So why is this a problem?"
  },
  {
    "startMs": 150800,
    "text": "So why is this a problem? AI open PRs just keep arriving."
  },
  {
    "startMs": 154550,
    "text": "AI open PRs just keep arriving."
  },
  {
    "startMs": 154560,
    "text": "AI open PRs just keep arriving. And to be fair, the safety net we"
  },
  {
    "startMs": 156790,
    "text": "And to be fair, the safety net we"
  },
  {
    "startMs": 156800,
    "text": "And to be fair, the safety net we already had works. CI checks together"
  },
  {
    "startMs": 160229,
    "text": "already had works. CI checks together"
  },
  {
    "startMs": 160239,
    "text": "already had works. CI checks together with a human review have always caught a"
  },
  {
    "startMs": 162630,
    "text": "with a human review have always caught a"
  },
  {
    "startMs": 162640,
    "text": "with a human review have always caught a lot of real bugs like broken code,"
  },
  {
    "startMs": 165110,
    "text": "lot of real bugs like broken code,"
  },
  {
    "startMs": 165120,
    "text": "lot of real bugs like broken code, inefficient queries and risks like"
  },
  {
    "startMs": 168070,
    "text": "inefficient queries and risks like"
  },
  {
    "startMs": 168080,
    "text": "inefficient queries and risks like downstream breakage or sensitive data"
  },
  {
    "startMs": 170229,
    "text": "downstream breakage or sensitive data"
  },
  {
    "startMs": 170239,
    "text": "downstream breakage or sensitive data leaks. But the human half only works at"
  },
  {
    "startMs": 173110,
    "text": "leaks. But the human half only works at"
  },
  {
    "startMs": 173120,
    "text": "leaks. But the human half only works at the human speed and only with the"
  },
  {
    "startMs": 175670,
    "text": "the human speed and only with the"
  },
  {
    "startMs": 175680,
    "text": "the human speed and only with the context a person happens to carry in"
  },
  {
    "startMs": 177750,
    "text": "context a person happens to carry in"
  },
  {
    "startMs": 177760,
    "text": "context a person happens to carry in their head. Who reads this table? How"
  },
  {
    "startMs": 180869,
    "text": "their head. Who reads this table? How"
  },
  {
    "startMs": 180879,
    "text": "their head. Who reads this table? How big is it? And how sensitive is the data"
  },
  {
    "startMs": 183350,
    "text": "big is it? And how sensitive is the data"
  },
  {
    "startMs": 183360,
    "text": "big is it? And how sensitive is the data in it? The PRs are coming in at the"
  },
  {
    "startMs": 186309,
    "text": "in it? The PRs are coming in at the"
  },
  {
    "startMs": 186319,
    "text": "in it? The PRs are coming in at the machine speed, but the number of people"
  },
  {
    "startMs": 188309,
    "text": "machine speed, but the number of people"
  },
  {
    "startMs": 188319,
    "text": "machine speed, but the number of people who understand what is safe to merge"
  },
  {
    "startMs": 190070,
    "text": "who understand what is safe to merge"
  },
  {
    "startMs": 190080,
    "text": "who understand what is safe to merge into a production data pipeline did not"
  },
  {
    "startMs": 192309,
    "text": "into a production data pipeline did not"
  },
  {
    "startMs": 192319,
    "text": "into a production data pipeline did not grow at all. That's the mismatch. The"
  },
  {
    "startMs": 195910,
    "text": "grow at all. That's the mismatch. The"
  },
  {
    "startMs": 195920,
    "text": "grow at all. That's the mismatch. The queue builds up in front of the few"
  },
  {
    "startMs": 197750,
    "text": "queue builds up in front of the few"
  },
  {
    "startMs": 197760,
    "text": "queue builds up in front of the few people with the context and that's where"
  },
  {
    "startMs": 199830,
    "text": "people with the context and that's where"
  },
  {
    "startMs": 199840,
    "text": "people with the context and that's where things start to slip."
  },
  {
    "startMs": 202949,
    "text": "things start to slip."
  },
  {
    "startMs": 202959,
    "text": "things start to slip. So the problem we set out to solve was"
  },
  {
    "startMs": 204790,
    "text": "So the problem we set out to solve was"
  },
  {
    "startMs": 204800,
    "text": "So the problem we set out to solve was this. Build a PR reviewer using AI that"
  },
  {
    "startMs": 208869,
    "text": "this. Build a PR reviewer using AI that"
  },
  {
    "startMs": 208879,
    "text": "this. Build a PR reviewer using AI that can keep up with the speed at which PRs"
  },
  {
    "startMs": 211110,
    "text": "can keep up with the speed at which PRs"
  },
  {
    "startMs": 211120,
    "text": "can keep up with the speed at which PRs are being opened."
  },
  {
    "startMs": 214229,
    "text": "are being opened."
  },
  {
    "startMs": 214239,
    "text": "are being opened. So here's the whole answer before we get"
  },
  {
    "startMs": 216309,
    "text": "So here's the whole answer before we get"
  },
  {
    "startMs": 216319,
    "text": "So here's the whole answer before we get into the details. Three duties, three"
  },
  {
    "startMs": 219110,
    "text": "into the details. Three duties, three"
  },
  {
    "startMs": 219120,
    "text": "into the details. Three duties, three owners."
  },
  {
    "startMs": 220869,
    "text": "owners."
  },
  {
    "startMs": 220879,
    "text": "owners. Scripts prove what can be proven. An"
  },
  {
    "startMs": 223830,
    "text": "Scripts prove what can be proven. An"
  },
  {
    "startMs": 223840,
    "text": "Scripts prove what can be proven. An agent judges what needs context and"
  },
  {
    "startMs": 226789,
    "text": "agent judges what needs context and"
  },
  {
    "startMs": 226799,
    "text": "agent judges what needs context and people own the calls only they should"
  },
  {
    "startMs": 229190,
    "text": "people own the calls only they should"
  },
  {
    "startMs": 229200,
    "text": "people own the calls only they should make. We took a hybrid approach. Scripts"
  },
  {
    "startMs": 232550,
    "text": "make. We took a hybrid approach. Scripts"
  },
  {
    "startMs": 232560,
    "text": "make. We took a hybrid approach. Scripts for the facts and AI for judgment. We"
  },
  {
    "startMs": 235750,
    "text": "for the facts and AI for judgment. We"
  },
  {
    "startMs": 235760,
    "text": "for the facts and AI for judgment. We did not want AI reviewing every change"
  },
  {
    "startMs": 238630,
    "text": "did not want AI reviewing every change"
  },
  {
    "startMs": 238640,
    "text": "did not want AI reviewing every change when some questions already have an"
  },
  {
    "startMs": 240630,
    "text": "when some questions already have an"
  },
  {
    "startMs": 240640,
    "text": "when some questions already have an authoritative answer."
  },
  {
    "startMs": 242949,
    "text": "authoritative answer."
  },
  {
    "startMs": 242959,
    "text": "authoritative answer. And that's layer one. Deterministic"
  },
  {
    "startMs": 246070,
    "text": "And that's layer one. Deterministic"
  },
  {
    "startMs": 246080,
    "text": "And that's layer one. Deterministic scripts check a source of truth like the"
  },
  {
    "startMs": 248710,
    "text": "scripts check a source of truth like the"
  },
  {
    "startMs": 248720,
    "text": "scripts check a source of truth like the schema registry or a catalog. A failed"
  },
  {
    "startMs": 251670,
    "text": "schema registry or a catalog. A failed"
  },
  {
    "startMs": 251680,
    "text": "schema registry or a catalog. A failed check turns CI red and blocks the PR"
  },
  {
    "startMs": 254309,
    "text": "check turns CI red and blocks the PR"
  },
  {
    "startMs": 254319,
    "text": "check turns CI red and blocks the PR until it is fixed."
  },
  {
    "startMs": 257030,
    "text": "until it is fixed."
  },
  {
    "startMs": 257040,
    "text": "until it is fixed. Layer two is the agent. The agents rules"
  },
  {
    "startMs": 260629,
    "text": "Layer two is the agent. The agents rules"
  },
  {
    "startMs": 260639,
    "text": "Layer two is the agent. The agents rules tell it what layer 1 already checks. So"
  },
  {
    "startMs": 263430,
    "text": "tell it what layer 1 already checks. So"
  },
  {
    "startMs": 263440,
    "text": "tell it what layer 1 already checks. So it focuses on the risks those checks"
  },
  {
    "startMs": 265749,
    "text": "it focuses on the risks those checks"
  },
  {
    "startMs": 265759,
    "text": "it focuses on the risks those checks cannot catch. It reviews the PR, scores"
  },
  {
    "startMs": 268870,
    "text": "cannot catch. It reviews the PR, scores"
  },
  {
    "startMs": 268880,
    "text": "cannot catch. It reviews the PR, scores the risk and approves or escalates to a"
  },
  {
    "startMs": 271510,
    "text": "the risk and approves or escalates to a"
  },
  {
    "startMs": 271520,
    "text": "the risk and approves or escalates to a person. Both these layers review the"
  },
  {
    "startMs": 274550,
    "text": "person. Both these layers review the"
  },
  {
    "startMs": 274560,
    "text": "person. Both these layers review the same PR. Merge requires passing checks"
  },
  {
    "startMs": 277670,
    "text": "same PR. Merge requires passing checks"
  },
  {
    "startMs": 277680,
    "text": "same PR. Merge requires passing checks and an approving review."
  },
  {
    "startMs": 280310,
    "text": "and an approving review."
  },
  {
    "startMs": 280320,
    "text": "and an approving review. And this also keeps AI costs down. We"
  },
  {
    "startMs": 283590,
    "text": "And this also keeps AI costs down. We"
  },
  {
    "startMs": 283600,
    "text": "And this also keeps AI costs down. We use AI for judgment, not to rediscover"
  },
  {
    "startMs": 286150,
    "text": "use AI for judgment, not to rediscover"
  },
  {
    "startMs": 286160,
    "text": "use AI for judgment, not to rediscover facts a script can look up."
  },
  {
    "startMs": 290230,
    "text": "facts a script can look up."
  },
  {
    "startMs": 290240,
    "text": "facts a script can look up. So here is where we are going today."
  },
  {
    "startMs": 293110,
    "text": "So here is where we are going today."
  },
  {
    "startMs": 293120,
    "text": "So here is where we are going today. We have covered the problem and the"
  },
  {
    "startMs": 294629,
    "text": "We have covered the problem and the"
  },
  {
    "startMs": 294639,
    "text": "We have covered the problem and the approach. Now I'll walk you through the"
  },
  {
    "startMs": 296870,
    "text": "approach. Now I'll walk you through the"
  },
  {
    "startMs": 296880,
    "text": "approach. Now I'll walk you through the hybrid reviewer we built and the"
  },
  {
    "startMs": 298950,
    "text": "hybrid reviewer we built and the"
  },
  {
    "startMs": 298960,
    "text": "hybrid reviewer we built and the decisions we deliberately keep with the"
  },
  {
    "startMs": 300790,
    "text": "decisions we deliberately keep with the"
  },
  {
    "startMs": 300800,
    "text": "decisions we deliberately keep with the people. After that how the reviewer"
  },
  {
    "startMs": 303990,
    "text": "people. After that how the reviewer"
  },
  {
    "startMs": 304000,
    "text": "people. After that how the reviewer learns from the human feedback and what"
  },
  {
    "startMs": 306150,
    "text": "learns from the human feedback and what"
  },
  {
    "startMs": 306160,
    "text": "learns from the human feedback and what results we have seen so far. And we'll"
  },
  {
    "startMs": 308710,
    "text": "results we have seen so far. And we'll"
  },
  {
    "startMs": 308720,
    "text": "results we have seen so far. And we'll finish with the lessons we would pass on"
  },
  {
    "startMs": 310390,
    "text": "finish with the lessons we would pass on"
  },
  {
    "startMs": 310400,
    "text": "finish with the lessons we would pass on to you."
  },
  {
    "startMs": 312390,
    "text": "to you."
  },
  {
    "startMs": 312400,
    "text": "to you. Three things to listen for as we go."
  },
  {
    "startMs": 315189,
    "text": "Three things to listen for as we go."
  },
  {
    "startMs": 315199,
    "text": "Three things to listen for as we go. Scripts for facts and agent for the"
  },
  {
    "startMs": 317830,
    "text": "Scripts for facts and agent for the"
  },
  {
    "startMs": 317840,
    "text": "Scripts for facts and agent for the judgment and people for the protected"
  },
  {
    "startMs": 320310,
    "text": "judgment and people for the protected"
  },
  {
    "startMs": 320320,
    "text": "judgment and people for the protected calls. I'll come back to all three at"
  },
  {
    "startMs": 322710,
    "text": "calls. I'll come back to all three at"
  },
  {
    "startMs": 322720,
    "text": "calls. I'll come back to all three at the end."
  },
  {
    "startMs": 324469,
    "text": "the end."
  },
  {
    "startMs": 324479,
    "text": "the end. So to make this concrete, let me show"
  },
  {
    "startMs": 327110,
    "text": "So to make this concrete, let me show"
  },
  {
    "startMs": 327120,
    "text": "So to make this concrete, let me show you the one PR will follow through the"
  },
  {
    "startMs": 329029,
    "text": "you the one PR will follow through the"
  },
  {
    "startMs": 329039,
    "text": "you the one PR will follow through the rest of this talk."
  },
  {
    "startMs": 333120,
    "text": "This PR makes two changes to a table in"
  },
  {
    "startMs": 336150,
    "text": "This PR makes two changes to a table in"
  },
  {
    "startMs": 336160,
    "text": "This PR makes two changes to a table in our data lake. It adds a new column and"
  },
  {
    "startMs": 339029,
    "text": "our data lake. It adds a new column and"
  },
  {
    "startMs": 339039,
    "text": "our data lake. It adds a new column and widens an existing column from integer"
  },
  {
    "startMs": 341029,
    "text": "widens an existing column from integer"
  },
  {
    "startMs": 341039,
    "text": "widens an existing column from integer to big integer. It's the kind of PR we"
  },
  {
    "startMs": 343350,
    "text": "to big integer. It's the kind of PR we"
  },
  {
    "startMs": 343360,
    "text": "to big integer. It's the kind of PR we see all the time. On the left is an"
  },
  {
    "startMs": 346390,
    "text": "see all the time. On the left is an"
  },
  {
    "startMs": 346400,
    "text": "see all the time. On the left is an upstream source table. Our injection"
  },
  {
    "startMs": 348950,
    "text": "upstream source table. Our injection"
  },
  {
    "startMs": 348960,
    "text": "upstream source table. Our injection pipeline reads from it and writes into a"
  },
  {
    "startMs": 351350,
    "text": "pipeline reads from it and writes into a"
  },
  {
    "startMs": 351360,
    "text": "pipeline reads from it and writes into a table in the data lake. call it our"
  },
  {
    "startMs": 353590,
    "text": "table in the data lake. call it our"
  },
  {
    "startMs": 353600,
    "text": "table in the data lake. call it our table."
  },
  {
    "startMs": 355510,
    "text": "table."
  },
  {
    "startMs": 355520,
    "text": "table. The first change, the source has gained"
  },
  {
    "startMs": 357909,
    "text": "The first change, the source has gained"
  },
  {
    "startMs": 357919,
    "text": "The first change, the source has gained a new column and this PR makes injection"
  },
  {
    "startMs": 361029,
    "text": "a new column and this PR makes injection"
  },
  {
    "startMs": 361039,
    "text": "a new column and this PR makes injection bring that new column into our lake"
  },
  {
    "startMs": 363110,
    "text": "bring that new column into our lake"
  },
  {
    "startMs": 363120,
    "text": "bring that new column into our lake table."
  },
  {
    "startMs": 365270,
    "text": "table."
  },
  {
    "startMs": 365280,
    "text": "table. The second change is to a column of a"
  },
  {
    "startMs": 367670,
    "text": "The second change is to a column of a"
  },
  {
    "startMs": 367680,
    "text": "The second change is to a column of a table already has"
  },
  {
    "startMs": 369830,
    "text": "table already has"
  },
  {
    "startMs": 369840,
    "text": "table already has its type gets widened from integer to"
  },
  {
    "startMs": 372710,
    "text": "its type gets widened from integer to"
  },
  {
    "startMs": 372720,
    "text": "its type gets widened from integer to big integer so it can hold bigger values"
  },
  {
    "startMs": 375990,
    "text": "big integer so it can hold bigger values"
  },
  {
    "startMs": 376000,
    "text": "big integer so it can hold bigger values on its own. That sounds completely"
  },
  {
    "startMs": 377749,
    "text": "on its own. That sounds completely"
  },
  {
    "startMs": 377759,
    "text": "on its own. That sounds completely harmless. Widening a type is about the"
  },
  {
    "startMs": 380629,
    "text": "harmless. Widening a type is about the"
  },
  {
    "startMs": 380639,
    "text": "harmless. Widening a type is about the safest schema change you can make,"
  },
  {
    "startMs": 382629,
    "text": "safest schema change you can make,"
  },
  {
    "startMs": 382639,
    "text": "safest schema change you can make, right?"
  },
  {
    "startMs": 384309,
    "text": "right?"
  },
  {
    "startMs": 384319,
    "text": "right? Well, whenever a column changes, the"
  },
  {
    "startMs": 386629,
    "text": "Well, whenever a column changes, the"
  },
  {
    "startMs": 386639,
    "text": "Well, whenever a column changes, the real question is who reads it"
  },
  {
    "startMs": 388469,
    "text": "real question is who reads it"
  },
  {
    "startMs": 388479,
    "text": "real question is who reads it downstream? Some of those readers are"
  },
  {
    "startMs": 390870,
    "text": "downstream? Some of those readers are"
  },
  {
    "startMs": 390880,
    "text": "downstream? Some of those readers are registered in our lineage tool. So, we"
  },
  {
    "startMs": 393350,
    "text": "registered in our lineage tool. So, we"
  },
  {
    "startMs": 393360,
    "text": "registered in our lineage tool. So, we know about them."
  },
  {
    "startMs": 395510,
    "text": "know about them."
  },
  {
    "startMs": 395520,
    "text": "know about them. But keep a second question in the back"
  },
  {
    "startMs": 396950,
    "text": "But keep a second question in the back"
  },
  {
    "startMs": 396960,
    "text": "But keep a second question in the back of your mind. Are those all of them?"
  },
  {
    "startMs": 400629,
    "text": "of your mind. Are those all of them?"
  },
  {
    "startMs": 400639,
    "text": "of your mind. Are those all of them? Hold on to this picture. We will come"
  },
  {
    "startMs": 403189,
    "text": "Hold on to this picture. We will come"
  },
  {
    "startMs": 403199,
    "text": "Hold on to this picture. We will come back to this exact diagram each time the"
  },
  {
    "startMs": 405189,
    "text": "back to this exact diagram each time the"
  },
  {
    "startMs": 405199,
    "text": "back to this exact diagram each time the PR moves forward through the reviewer."
  },
  {
    "startMs": 409759,
    "text": "So let's start with layer one. Layer one"
  },
  {
    "startMs": 412309,
    "text": "So let's start with layer one. Layer one"
  },
  {
    "startMs": 412319,
    "text": "So let's start with layer one. Layer one is the scripts and their whole job is"
  },
  {
    "startMs": 414790,
    "text": "is the scripts and their whole job is"
  },
  {
    "startMs": 414800,
    "text": "is the scripts and their whole job is checking facts in the live systems."
  },
  {
    "startMs": 417510,
    "text": "checking facts in the live systems."
  },
  {
    "startMs": 417520,
    "text": "checking facts in the live systems. Things the code alone cannot tell you."
  },
  {
    "startMs": 420550,
    "text": "Things the code alone cannot tell you."
  },
  {
    "startMs": 420560,
    "text": "Things the code alone cannot tell you. Here are the two of those checks and"
  },
  {
    "startMs": 423029,
    "text": "Here are the two of those checks and"
  },
  {
    "startMs": 423039,
    "text": "Here are the two of those checks and what they said about our running PR."
  },
  {
    "startMs": 427189,
    "text": "what they said about our running PR."
  },
  {
    "startMs": 427199,
    "text": "what they said about our running PR. First data contracts. When a PR changes"
  },
  {
    "startMs": 430790,
    "text": "First data contracts. When a PR changes"
  },
  {
    "startMs": 430800,
    "text": "First data contracts. When a PR changes a schema, a script compares the schema"
  },
  {
    "startMs": 433749,
    "text": "a schema, a script compares the schema"
  },
  {
    "startMs": 433759,
    "text": "a schema, a script compares the schema and keys against a source of truth, the"
  },
  {
    "startMs": 436230,
    "text": "and keys against a source of truth, the"
  },
  {
    "startMs": 436240,
    "text": "and keys against a source of truth, the schema registry."
  },
  {
    "startMs": 438070,
    "text": "schema registry."
  },
  {
    "startMs": 438080,
    "text": "schema registry. for our PR. The question is simple. Does"
  },
  {
    "startMs": 440629,
    "text": "for our PR. The question is simple. Does"
  },
  {
    "startMs": 440639,
    "text": "for our PR. The question is simple. Does that new column actually exist upstream"
  },
  {
    "startMs": 443110,
    "text": "that new column actually exist upstream"
  },
  {
    "startMs": 443120,
    "text": "that new column actually exist upstream as registered in the registry? It does."
  },
  {
    "startMs": 446710,
    "text": "as registered in the registry? It does."
  },
  {
    "startMs": 446720,
    "text": "as registered in the registry? It does. So that check passes."
  },
  {
    "startMs": 449909,
    "text": "So that check passes."
  },
  {
    "startMs": 449919,
    "text": "So that check passes. Second require tags. Every table needs"
  },
  {
    "startMs": 453270,
    "text": "Second require tags. Every table needs"
  },
  {
    "startMs": 453280,
    "text": "Second require tags. Every table needs an owner and any PII has to be labeled"
  },
  {
    "startMs": 455830,
    "text": "an owner and any PII has to be labeled"
  },
  {
    "startMs": 455840,
    "text": "an owner and any PII has to be labeled in the catalog. The script checks the"
  },
  {
    "startMs": 458950,
    "text": "in the catalog. The script checks the"
  },
  {
    "startMs": 458960,
    "text": "in the catalog. The script checks the catalog directly. Does our table have an"
  },
  {
    "startMs": 461350,
    "text": "catalog directly. Does our table have an"
  },
  {
    "startMs": 461360,
    "text": "catalog directly. Does our table have an owner? Yes. Is its PII labeled? Yes."
  },
  {
    "startMs": 465990,
    "text": "owner? Yes. Is its PII labeled? Yes."
  },
  {
    "startMs": 466000,
    "text": "owner? Yes. Is its PII labeled? Yes. pass again."
  },
  {
    "startMs": 468390,
    "text": "pass again."
  },
  {
    "startMs": 468400,
    "text": "pass again. And if either of those had failed, there"
  },
  {
    "startMs": 470790,
    "text": "And if either of those had failed, there"
  },
  {
    "startMs": 470800,
    "text": "And if either of those had failed, there is no debate and no model involved. CI"
  },
  {
    "startMs": 473589,
    "text": "is no debate and no model involved. CI"
  },
  {
    "startMs": 473599,
    "text": "is no debate and no model involved. CI goes red like any other failing checks"
  },
  {
    "startMs": 476150,
    "text": "goes red like any other failing checks"
  },
  {
    "startMs": 476160,
    "text": "goes red like any other failing checks and the PR is blocked until it is fixed."
  },
  {
    "startMs": 480150,
    "text": "and the PR is blocked until it is fixed."
  },
  {
    "startMs": 480160,
    "text": "and the PR is blocked until it is fixed. Contracts and tags are two of the layer"
  },
  {
    "startMs": 482309,
    "text": "Contracts and tags are two of the layer"
  },
  {
    "startMs": 482319,
    "text": "Contracts and tags are two of the layer 1 checks. Next, the two that look at"
  },
  {
    "startMs": 485830,
    "text": "1 checks. Next, the two that look at"
  },
  {
    "startMs": 485840,
    "text": "1 checks. Next, the two that look at downstream impact and performance. So"
  },
  {
    "startMs": 488390,
    "text": "downstream impact and performance. So"
  },
  {
    "startMs": 488400,
    "text": "downstream impact and performance. So these are the other two layer 1 checks."
  },
  {
    "startMs": 490950,
    "text": "these are the other two layer 1 checks."
  },
  {
    "startMs": 490960,
    "text": "these are the other two layer 1 checks. They look past the table itself, what"
  },
  {
    "startMs": 493270,
    "text": "They look past the table itself, what"
  },
  {
    "startMs": 493280,
    "text": "They look past the table itself, what happens downstream and whether the job"
  },
  {
    "startMs": 495589,
    "text": "happens downstream and whether the job"
  },
  {
    "startMs": 495599,
    "text": "happens downstream and whether the job will still run in time."
  },
  {
    "startMs": 499029,
    "text": "will still run in time."
  },
  {
    "startMs": 499039,
    "text": "will still run in time. First, the lineage blast radius. When a"
  },
  {
    "startMs": 502390,
    "text": "First, the lineage blast radius. When a"
  },
  {
    "startMs": 502400,
    "text": "First, the lineage blast radius. When a column changes, like the one our PR"
  },
  {
    "startMs": 504469,
    "text": "column changes, like the one our PR"
  },
  {
    "startMs": 504479,
    "text": "column changes, like the one our PR widens, a script walks every downstream"
  },
  {
    "startMs": 507270,
    "text": "widens, a script walks every downstream"
  },
  {
    "startMs": 507280,
    "text": "widens, a script walks every downstream job the lineage tool has on record for"
  },
  {
    "startMs": 509270,
    "text": "job the lineage tool has on record for"
  },
  {
    "startMs": 509280,
    "text": "job the lineage tool has on record for that column and asks a simple question."
  },
  {
    "startMs": 512230,
    "text": "that column and asks a simple question."
  },
  {
    "startMs": 512240,
    "text": "that column and asks a simple question. Does any of them break? It's a real"
  },
  {
    "startMs": 514870,
    "text": "Does any of them break? It's a real"
  },
  {
    "startMs": 514880,
    "text": "Does any of them break? It's a real check against a real system. But notice"
  },
  {
    "startMs": 517829,
    "text": "check against a real system. But notice"
  },
  {
    "startMs": 517839,
    "text": "check against a real system. But notice the boundary I have drawn. It can only"
  },
  {
    "startMs": 520709,
    "text": "the boundary I have drawn. It can only"
  },
  {
    "startMs": 520719,
    "text": "the boundary I have drawn. It can only see what is recorded in lineage. Its"
  },
  {
    "startMs": 523509,
    "text": "see what is recorded in lineage. Its"
  },
  {
    "startMs": 523519,
    "text": "see what is recorded in lineage. Its view of downstream is exactly as"
  },
  {
    "startMs": 526150,
    "text": "view of downstream is exactly as"
  },
  {
    "startMs": 526160,
    "text": "view of downstream is exactly as complete as that record. No more."
  },
  {
    "startMs": 529990,
    "text": "complete as that record. No more."
  },
  {
    "startMs": 530000,
    "text": "complete as that record. No more. Second, the performance. A correct"
  },
  {
    "startMs": 532630,
    "text": "Second, the performance. A correct"
  },
  {
    "startMs": 532640,
    "text": "Second, the performance. A correct change can still be too slow or too"
  },
  {
    "startMs": 534550,
    "text": "change can still be too slow or too"
  },
  {
    "startMs": 534560,
    "text": "change can still be too slow or too expensive. So the CI performance test"
  },
  {
    "startMs": 537509,
    "text": "expensive. So the CI performance test"
  },
  {
    "startMs": 537519,
    "text": "expensive. So the CI performance test runs the change in staging at the same"
  },
  {
    "startMs": 539990,
    "text": "runs the change in staging at the same"
  },
  {
    "startMs": 540000,
    "text": "runs the change in staging at the same data volume as production using mock"
  },
  {
    "startMs": 542150,
    "text": "data volume as production using mock"
  },
  {
    "startMs": 542160,
    "text": "data volume as production using mock data."
  },
  {
    "startMs": 544310,
    "text": "data."
  },
  {
    "startMs": 544320,
    "text": "data. So that tells us two things before the"
  },
  {
    "startMs": 546230,
    "text": "So that tells us two things before the"
  },
  {
    "startMs": 546240,
    "text": "So that tells us two things before the PR merges. whether the cluster is sized"
  },
  {
    "startMs": 548710,
    "text": "PR merges. whether the cluster is sized"
  },
  {
    "startMs": 548720,
    "text": "PR merges. whether the cluster is sized right for the job and whether the job"
  },
  {
    "startMs": 550710,
    "text": "right for the job and whether the job"
  },
  {
    "startMs": 550720,
    "text": "right for the job and whether the job will still make its freshness SLA. Those"
  },
  {
    "startMs": 554150,
    "text": "will still make its freshness SLA. Those"
  },
  {
    "startMs": 554160,
    "text": "will still make its freshness SLA. Those are the kind of problems that otherwise"
  },
  {
    "startMs": 556470,
    "text": "are the kind of problems that otherwise"
  },
  {
    "startMs": 556480,
    "text": "are the kind of problems that otherwise show up weeks later as an incident. So"
  },
  {
    "startMs": 559590,
    "text": "show up weeks later as an incident. So"
  },
  {
    "startMs": 559600,
    "text": "show up weeks later as an incident. So that's the full set of layer 1 checks."
  },
  {
    "startMs": 562550,
    "text": "that's the full set of layer 1 checks."
  },
  {
    "startMs": 562560,
    "text": "that's the full set of layer 1 checks. Let's see what they said about our PR."
  },
  {
    "startMs": 567839,
    "text": "So back to our running PR. Same picture"
  },
  {
    "startMs": 570389,
    "text": "So back to our running PR. Same picture"
  },
  {
    "startMs": 570399,
    "text": "So back to our running PR. Same picture as before. Here's what the layer one"
  },
  {
    "startMs": 572710,
    "text": "as before. Here's what the layer one"
  },
  {
    "startMs": 572720,
    "text": "as before. Here's what the layer one said about it."
  },
  {
    "startMs": 575269,
    "text": "said about it."
  },
  {
    "startMs": 575279,
    "text": "said about it. The data contract check went to the"
  },
  {
    "startMs": 577509,
    "text": "The data contract check went to the"
  },
  {
    "startMs": 577519,
    "text": "The data contract check went to the schema registry and asked whether the"
  },
  {
    "startMs": 579750,
    "text": "schema registry and asked whether the"
  },
  {
    "startMs": 579760,
    "text": "schema registry and asked whether the new column really exists upstream as"
  },
  {
    "startMs": 581910,
    "text": "new column really exists upstream as"
  },
  {
    "startMs": 581920,
    "text": "new column really exists upstream as register. It does and the check passes."
  },
  {
    "startMs": 586630,
    "text": "register. It does and the check passes."
  },
  {
    "startMs": 586640,
    "text": "register. It does and the check passes. The leanage blast radius check walked"
  },
  {
    "startMs": 588710,
    "text": "The leanage blast radius check walked"
  },
  {
    "startMs": 588720,
    "text": "The leanage blast radius check walked every registered consumer of the widen"
  },
  {
    "startMs": 590630,
    "text": "every registered consumer of the widen"
  },
  {
    "startMs": 590640,
    "text": "every registered consumer of the widen column. The jobs the lenage tool has on"
  },
  {
    "startMs": 593110,
    "text": "column. The jobs the lenage tool has on"
  },
  {
    "startMs": 593120,
    "text": "column. The jobs the lenage tool has on record. None of them break when the"
  },
  {
    "startMs": 595269,
    "text": "record. None of them break when the"
  },
  {
    "startMs": 595279,
    "text": "record. None of them break when the column goes from integer to big integer."
  },
  {
    "startMs": 597430,
    "text": "column goes from integer to big integer."
  },
  {
    "startMs": 597440,
    "text": "column goes from integer to big integer. They all look fine. Along with that tags"
  },
  {
    "startMs": 601110,
    "text": "They all look fine. Along with that tags"
  },
  {
    "startMs": 601120,
    "text": "They all look fine. Along with that tags pass, performance passes. Every check is"
  },
  {
    "startMs": 603990,
    "text": "pass, performance passes. Every check is"
  },
  {
    "startMs": 604000,
    "text": "pass, performance passes. Every check is green."
  },
  {
    "startMs": 605590,
    "text": "green."
  },
  {
    "startMs": 605600,
    "text": "green. As far as the scripts can see, this PR"
  },
  {
    "startMs": 607670,
    "text": "As far as the scripts can see, this PR"
  },
  {
    "startMs": 607680,
    "text": "As far as the scripts can see, this PR is safe. But I chose those words"
  },
  {
    "startMs": 609990,
    "text": "is safe. But I chose those words"
  },
  {
    "startMs": 610000,
    "text": "is safe. But I chose those words carefully. As far as the scripts can"
  },
  {
    "startMs": 612710,
    "text": "carefully. As far as the scripts can"
  },
  {
    "startMs": 612720,
    "text": "carefully. As far as the scripts can see, everything on the slide is a"
  },
  {
    "startMs": 615269,
    "text": "see, everything on the slide is a"
  },
  {
    "startMs": 615279,
    "text": "see, everything on the slide is a statement about the registered picture,"
  },
  {
    "startMs": 617590,
    "text": "statement about the registered picture,"
  },
  {
    "startMs": 617600,
    "text": "statement about the registered picture, the jobs and the columns our systems"
  },
  {
    "startMs": 619750,
    "text": "the jobs and the columns our systems"
  },
  {
    "startMs": 619760,
    "text": "the jobs and the columns our systems have a record of. And keep that in mind."
  },
  {
    "startMs": 623110,
    "text": "have a record of. And keep that in mind."
  },
  {
    "startMs": 623120,
    "text": "have a record of. And keep that in mind. It is not the whole story."
  },
  {
    "startMs": 626069,
    "text": "It is not the whole story."
  },
  {
    "startMs": 626079,
    "text": "It is not the whole story. Now let's look at the agent with the"
  },
  {
    "startMs": 628389,
    "text": "Now let's look at the agent with the"
  },
  {
    "startMs": 628399,
    "text": "Now let's look at the agent with the diff. What actually changed?"
  },
  {
    "startMs": 631829,
    "text": "diff. What actually changed?"
  },
  {
    "startMs": 631839,
    "text": "diff. What actually changed? The PR description and the commit"
  },
  {
    "startMs": 633509,
    "text": "The PR description and the commit"
  },
  {
    "startMs": 633519,
    "text": "The PR description and the commit messages explain the author's intent,"
  },
  {
    "startMs": 635910,
    "text": "messages explain the author's intent,"
  },
  {
    "startMs": 635920,
    "text": "messages explain the author's intent, but intent never explains away a real"
  },
  {
    "startMs": 638470,
    "text": "but intent never explains away a real"
  },
  {
    "startMs": 638480,
    "text": "but intent never explains away a real finding. If the description says it is"
  },
  {
    "startMs": 641269,
    "text": "finding. If the description says it is"
  },
  {
    "startMs": 641279,
    "text": "finding. If the description says it is safe and the code says otherwise, the"
  },
  {
    "startMs": 643590,
    "text": "safe and the code says otherwise, the"
  },
  {
    "startMs": 643600,
    "text": "safe and the code says otherwise, the code wins."
  },
  {
    "startMs": 646310,
    "text": "code wins."
  },
  {
    "startMs": 646320,
    "text": "code wins. File tools let the agent read, search,"
  },
  {
    "startMs": 648470,
    "text": "File tools let the agent read, search,"
  },
  {
    "startMs": 648480,
    "text": "File tools let the agent read, search, and list the files across the"
  },
  {
    "startMs": 649910,
    "text": "and list the files across the"
  },
  {
    "startMs": 649920,
    "text": "and list the files across the repository. It follows changes beyond"
  },
  {
    "startMs": 652710,
    "text": "repository. It follows changes beyond"
  },
  {
    "startMs": 652720,
    "text": "repository. It follows changes beyond the diff into pipeline definitions and"
  },
  {
    "startMs": 654949,
    "text": "the diff into pipeline definitions and"
  },
  {
    "startMs": 654959,
    "text": "the diff into pipeline definitions and access grants looking for the"
  },
  {
    "startMs": 656870,
    "text": "access grants looking for the"
  },
  {
    "startMs": 656880,
    "text": "access grants looking for the relationships the author may have"
  },
  {
    "startMs": 658310,
    "text": "relationships the author may have"
  },
  {
    "startMs": 658320,
    "text": "relationships the author may have missed."
  },
  {
    "startMs": 661030,
    "text": "missed."
  },
  {
    "startMs": 661040,
    "text": "missed. These are the repository repository"
  },
  {
    "startMs": 663030,
    "text": "These are the repository repository"
  },
  {
    "startMs": 663040,
    "text": "These are the repository repository tools only. The agent cannot query the"
  },
  {
    "startMs": 665910,
    "text": "tools only. The agent cannot query the"
  },
  {
    "startMs": 665920,
    "text": "tools only. The agent cannot query the live catalog lineage tool or production"
  },
  {
    "startMs": 668470,
    "text": "live catalog lineage tool or production"
  },
  {
    "startMs": 668480,
    "text": "live catalog lineage tool or production state. Life facts stay layer 1's job."
  },
  {
    "startMs": 672550,
    "text": "state. Life facts stay layer 1's job."
  },
  {
    "startMs": 672560,
    "text": "state. Life facts stay layer 1's job. The agent reasons over the code. So why"
  },
  {
    "startMs": 675590,
    "text": "The agent reasons over the code. So why"
  },
  {
    "startMs": 675600,
    "text": "The agent reasons over the code. So why walk that code for a schema change?"
  },
  {
    "startMs": 677990,
    "text": "walk that code for a schema change?"
  },
  {
    "startMs": 678000,
    "text": "walk that code for a schema change? Because registered lineage is not the"
  },
  {
    "startMs": 680550,
    "text": "Because registered lineage is not the"
  },
  {
    "startMs": 680560,
    "text": "Because registered lineage is not the whole picture."
  },
  {
    "startMs": 683750,
    "text": "whole picture."
  },
  {
    "startMs": 683760,
    "text": "whole picture. The rules define where the judgment"
  },
  {
    "startMs": 686310,
    "text": "The rules define where the judgment"
  },
  {
    "startMs": 686320,
    "text": "The rules define where the judgment belongs. They are configured by the"
  },
  {
    "startMs": 688310,
    "text": "belongs. They are configured by the"
  },
  {
    "startMs": 688320,
    "text": "belongs. They are configured by the change type in the PR knowing what layer"
  },
  {
    "startMs": 690550,
    "text": "change type in the PR knowing what layer"
  },
  {
    "startMs": 690560,
    "text": "change type in the PR knowing what layer 1 already covers. They target query anti"
  },
  {
    "startMs": 693750,
    "text": "1 already covers. They target query anti"
  },
  {
    "startMs": 693760,
    "text": "1 already covers. They target query anti patterns, sensitive data asks and"
  },
  {
    "startMs": 696389,
    "text": "patterns, sensitive data asks and"
  },
  {
    "startMs": 696399,
    "text": "patterns, sensitive data asks and consumers outside lineage."
  },
  {
    "startMs": 699269,
    "text": "consumers outside lineage."
  },
  {
    "startMs": 699279,
    "text": "consumers outside lineage. For example, an unpartitioned cross join"
  },
  {
    "startMs": 701670,
    "text": "For example, an unpartitioned cross join"
  },
  {
    "startMs": 701680,
    "text": "For example, an unpartitioned cross join can run correctly and still hammer a"
  },
  {
    "startMs": 703430,
    "text": "can run correctly and still hammer a"
  },
  {
    "startMs": 703440,
    "text": "can run correctly and still hammer a cluster. A grant can look ordinary and"
  },
  {
    "startMs": 706310,
    "text": "cluster. A grant can look ordinary and"
  },
  {
    "startMs": 706320,
    "text": "cluster. A grant can look ordinary and still open sensitive data."
  },
  {
    "startMs": 708870,
    "text": "still open sensitive data."
  },
  {
    "startMs": 708880,
    "text": "still open sensitive data. And for the schema changes, the agent"
  },
  {
    "startMs": 711190,
    "text": "And for the schema changes, the agent"
  },
  {
    "startMs": 711200,
    "text": "And for the schema changes, the agent walks the pipeline definitions and"
  },
  {
    "startMs": 713110,
    "text": "walks the pipeline definitions and"
  },
  {
    "startMs": 713120,
    "text": "walks the pipeline definitions and access grants in the repository to find"
  },
  {
    "startMs": 715509,
    "text": "access grants in the repository to find"
  },
  {
    "startMs": 715519,
    "text": "access grants in the repository to find consumers that were not registered. It's"
  },
  {
    "startMs": 718630,
    "text": "consumers that were not registered. It's"
  },
  {
    "startMs": 718640,
    "text": "consumers that were not registered. It's a tedious search uh a person would"
  },
  {
    "startMs": 720550,
    "text": "a tedious search uh a person would"
  },
  {
    "startMs": 720560,
    "text": "a tedious search uh a person would otherwise do by hand."
  },
  {
    "startMs": 722949,
    "text": "otherwise do by hand."
  },
  {
    "startMs": 722959,
    "text": "otherwise do by hand. Let's return to our PR and see what that"
  },
  {
    "startMs": 724949,
    "text": "Let's return to our PR and see what that"
  },
  {
    "startMs": 724959,
    "text": "Let's return to our PR and see what that search found."
  },
  {
    "startMs": 727829,
    "text": "search found."
  },
  {
    "startMs": 727839,
    "text": "search found. So back to our running PR. Same picture."
  },
  {
    "startMs": 730790,
    "text": "So back to our running PR. Same picture."
  },
  {
    "startMs": 730800,
    "text": "So back to our running PR. Same picture. Layer 1 said every registered consumer"
  },
  {
    "startMs": 733110,
    "text": "Layer 1 said every registered consumer"
  },
  {
    "startMs": 733120,
    "text": "Layer 1 said every registered consumer of the vid column looks fine. Now the"
  },
  {
    "startMs": 736150,
    "text": "of the vid column looks fine. Now the"
  },
  {
    "startMs": 736160,
    "text": "of the vid column looks fine. Now the agent walks the code"
  },
  {
    "startMs": 738550,
    "text": "agent walks the code"
  },
  {
    "startMs": 738560,
    "text": "agent walks the code and it finds a job that lineage never"
  },
  {
    "startMs": 741110,
    "text": "and it finds a job that lineage never"
  },
  {
    "startMs": 741120,
    "text": "and it finds a job that lineage never knew about. It's right there in the"
  },
  {
    "startMs": 743350,
    "text": "knew about. It's right there in the"
  },
  {
    "startMs": 743360,
    "text": "knew about. It's right there in the repository. It reads our widen column"
  },
  {
    "startMs": 746230,
    "text": "repository. It reads our widen column"
  },
  {
    "startMs": 746240,
    "text": "repository. It reads our widen column from our late table but it was never"
  },
  {
    "startMs": 748389,
    "text": "from our late table but it was never"
  },
  {
    "startMs": 748399,
    "text": "from our late table but it was never registered in the lineage which is"
  },
  {
    "startMs": 750230,
    "text": "registered in the lineage which is"
  },
  {
    "startMs": 750240,
    "text": "registered in the lineage which is exactly why the layer 1 check could not"
  },
  {
    "startMs": 752310,
    "text": "exactly why the layer 1 check could not"
  },
  {
    "startMs": 752320,
    "text": "exactly why the layer 1 check could not see it."
  },
  {
    "startMs": 754069,
    "text": "see it."
  },
  {
    "startMs": 754079,
    "text": "see it. And that job takes the value and writes"
  },
  {
    "startMs": 756629,
    "text": "And that job takes the value and writes"
  },
  {
    "startMs": 756639,
    "text": "And that job takes the value and writes it into another table. And in that other"
  },
  {
    "startMs": 759509,
    "text": "it into another table. And in that other"
  },
  {
    "startMs": 759519,
    "text": "it into another table. And in that other table, the column is still an integer."
  },
  {
    "startMs": 763110,
    "text": "table, the column is still an integer."
  },
  {
    "startMs": 763120,
    "text": "table, the column is still an integer. Now follow it through. Our column is a"
  },
  {
    "startMs": 765670,
    "text": "Now follow it through. Our column is a"
  },
  {
    "startMs": 765680,
    "text": "Now follow it through. Our column is a big integer. Now the first time a value"
  },
  {
    "startMs": 768470,
    "text": "big integer. Now the first time a value"
  },
  {
    "startMs": 768480,
    "text": "big integer. Now the first time a value comes through that's bigger than an"
  },
  {
    "startMs": 770870,
    "text": "comes through that's bigger than an"
  },
  {
    "startMs": 770880,
    "text": "comes through that's bigger than an integer can hold that right fails. A"
  },
  {
    "startMs": 774310,
    "text": "integer can hold that right fails. A"
  },
  {
    "startMs": 774320,
    "text": "integer can hold that right fails. A valid schema change green in CI passes"
  },
  {
    "startMs": 777750,
    "text": "valid schema change green in CI passes"
  },
  {
    "startMs": 777760,
    "text": "valid schema change green in CI passes every registered check and a downstream"
  },
  {
    "startMs": 779990,
    "text": "every registered check and a downstream"
  },
  {
    "startMs": 780000,
    "text": "every registered check and a downstream job still breaks."
  },
  {
    "startMs": 783030,
    "text": "job still breaks."
  },
  {
    "startMs": 783040,
    "text": "job still breaks. The agent flagged exactly this chain in"
  },
  {
    "startMs": 785509,
    "text": "The agent flagged exactly this chain in"
  },
  {
    "startMs": 785519,
    "text": "The agent flagged exactly this chain in its review comment with the reasoning."
  },
  {
    "startMs": 787910,
    "text": "its review comment with the reasoning."
  },
  {
    "startMs": 787920,
    "text": "its review comment with the reasoning. So a person could see the whole path"
  },
  {
    "startMs": 789910,
    "text": "So a person could see the whole path"
  },
  {
    "startMs": 789920,
    "text": "So a person could see the whole path from our column to the failing right."
  },
  {
    "startMs": 792230,
    "text": "from our column to the failing right."
  },
  {
    "startMs": 792240,
    "text": "from our column to the failing right. We'll get to what happened next in a"
  },
  {
    "startMs": 793990,
    "text": "We'll get to what happened next in a"
  },
  {
    "startMs": 794000,
    "text": "We'll get to what happened next in a moment."
  },
  {
    "startMs": 796389,
    "text": "moment."
  },
  {
    "startMs": 796399,
    "text": "moment. So why did the lineage miss that job?"
  },
  {
    "startMs": 799269,
    "text": "So why did the lineage miss that job?"
  },
  {
    "startMs": 799279,
    "text": "So why did the lineage miss that job? Because the enterprise data world is"
  },
  {
    "startMs": 800949,
    "text": "Because the enterprise data world is"
  },
  {
    "startMs": 800959,
    "text": "Because the enterprise data world is messy. Workloads run across different"
  },
  {
    "startMs": 803430,
    "text": "messy. Workloads run across different"
  },
  {
    "startMs": 803440,
    "text": "messy. Workloads run across different query engines and each engine has to"
  },
  {
    "startMs": 805750,
    "text": "query engines and each engine has to"
  },
  {
    "startMs": 805760,
    "text": "query engines and each engine has to publish its own lineage. If one does not"
  },
  {
    "startMs": 808629,
    "text": "publish its own lineage. If one does not"
  },
  {
    "startMs": 808639,
    "text": "publish its own lineage. If one does not publish, that relationship is missing"
  },
  {
    "startMs": 810629,
    "text": "publish, that relationship is missing"
  },
  {
    "startMs": 810639,
    "text": "publish, that relationship is missing from the picture. There's a single"
  },
  {
    "startMs": 812629,
    "text": "from the picture. There's a single"
  },
  {
    "startMs": 812639,
    "text": "from the picture. There's a single catalog that automatically sees"
  },
  {
    "startMs": 814310,
    "text": "catalog that automatically sees"
  },
  {
    "startMs": 814320,
    "text": "catalog that automatically sees everything. So the registered picture is"
  },
  {
    "startMs": 816790,
    "text": "everything. So the registered picture is"
  },
  {
    "startMs": 816800,
    "text": "everything. So the registered picture is useful but it is not the whole picture."
  },
  {
    "startMs": 821350,
    "text": "useful but it is not the whole picture."
  },
  {
    "startMs": 821360,
    "text": "useful but it is not the whole picture. Now I don't want to oversell the"
  },
  {
    "startMs": 823269,
    "text": "Now I don't want to oversell the"
  },
  {
    "startMs": 823279,
    "text": "Now I don't want to oversell the codewalk. It's genuinely useful but it"
  },
  {
    "startMs": 826150,
    "text": "codewalk. It's genuinely useful but it"
  },
  {
    "startMs": 826160,
    "text": "codewalk. It's genuinely useful but it cannot see everything."
  },
  {
    "startMs": 828710,
    "text": "cannot see everything."
  },
  {
    "startMs": 828720,
    "text": "cannot see everything. The agent can search what is in the"
  },
  {
    "startMs": 830790,
    "text": "The agent can search what is in the"
  },
  {
    "startMs": 830800,
    "text": "The agent can search what is in the repo. Pipeline code access grants and"
  },
  {
    "startMs": 833430,
    "text": "repo. Pipeline code access grants and"
  },
  {
    "startMs": 833440,
    "text": "repo. Pipeline code access grants and the jobs defined there that read our"
  },
  {
    "startMs": 835990,
    "text": "the jobs defined there that read our"
  },
  {
    "startMs": 836000,
    "text": "the jobs defined there that read our tables. That's where it found our"
  },
  {
    "startMs": 838310,
    "text": "tables. That's where it found our"
  },
  {
    "startMs": 838320,
    "text": "tables. That's where it found our unregistered job. But plenty of data use"
  },
  {
    "startMs": 842069,
    "text": "unregistered job. But plenty of data use"
  },
  {
    "startMs": 842079,
    "text": "unregistered job. But plenty of data use lives outside the codebase. Ad hawk"
  },
  {
    "startMs": 844310,
    "text": "lives outside the codebase. Ad hawk"
  },
  {
    "startMs": 844320,
    "text": "lives outside the codebase. Ad hawk queries that someone runs by hand."
  },
  {
    "startMs": 846550,
    "text": "queries that someone runs by hand."
  },
  {
    "startMs": 846560,
    "text": "queries that someone runs by hand. Dashboards, those are completely"
  },
  {
    "startMs": 848470,
    "text": "Dashboards, those are completely"
  },
  {
    "startMs": 848480,
    "text": "Dashboards, those are completely invisible to a repository search. A"
  },
  {
    "startMs": 851110,
    "text": "invisible to a repository search. A"
  },
  {
    "startMs": 851120,
    "text": "invisible to a repository search. A consumer out there never shows up, no"
  },
  {
    "startMs": 853110,
    "text": "consumer out there never shows up, no"
  },
  {
    "startMs": 853120,
    "text": "consumer out there never shows up, no matter how carefully the agent looks. So"
  },
  {
    "startMs": 855990,
    "text": "matter how carefully the agent looks. So"
  },
  {
    "startMs": 856000,
    "text": "matter how carefully the agent looks. So we make the agent honest about that"
  },
  {
    "startMs": 857829,
    "text": "we make the agent honest about that"
  },
  {
    "startMs": 857839,
    "text": "we make the agent honest about that limit. If it does not find anything, it"
  },
  {
    "startMs": 860550,
    "text": "limit. If it does not find anything, it"
  },
  {
    "startMs": 860560,
    "text": "limit. If it does not find anything, it does not get to say no downstream"
  },
  {
    "startMs": 862230,
    "text": "does not get to say no downstream"
  },
  {
    "startMs": 862240,
    "text": "does not get to say no downstream consumers exist. It says it found none"
  },
  {
    "startMs": 865509,
    "text": "consumers exist. It says it found none"
  },
  {
    "startMs": 865519,
    "text": "consumers exist. It says it found none in the places it searched. None found is"
  },
  {
    "startMs": 868790,
    "text": "in the places it searched. None found is"
  },
  {
    "startMs": 868800,
    "text": "in the places it searched. None found is not the same as none exist and the agent"
  },
  {
    "startMs": 871590,
    "text": "not the same as none exist and the agent"
  },
  {
    "startMs": 871600,
    "text": "not the same as none exist and the agent never gets to claim an allcle."
  },
  {
    "startMs": 876240,
    "text": "So the agent has walked the code. What"
  },
  {
    "startMs": 878470,
    "text": "So the agent has walked the code. What"
  },
  {
    "startMs": 878480,
    "text": "So the agent has walked the code. What does it actually produce? A review the"
  },
  {
    "startMs": 881189,
    "text": "does it actually produce? A review the"
  },
  {
    "startMs": 881199,
    "text": "does it actually produce? A review the same shape a good human reviewer would"
  },
  {
    "startMs": 883509,
    "text": "same shape a good human reviewer would"
  },
  {
    "startMs": 883519,
    "text": "same shape a good human reviewer would give you."
  },
  {
    "startMs": 885269,
    "text": "give you."
  },
  {
    "startMs": 885279,
    "text": "give you. First review comments on the specific"
  },
  {
    "startMs": 887750,
    "text": "First review comments on the specific"
  },
  {
    "startMs": 887760,
    "text": "First review comments on the specific lines that matter each with its"
  },
  {
    "startMs": 890230,
    "text": "lines that matter each with its"
  },
  {
    "startMs": 890240,
    "text": "lines that matter each with its reasoning. Not awake looks risky but"
  },
  {
    "startMs": 893829,
    "text": "reasoning. Not awake looks risky but"
  },
  {
    "startMs": 893839,
    "text": "reasoning. Not awake looks risky but this line changes this column. And here"
  },
  {
    "startMs": 895990,
    "text": "this line changes this column. And here"
  },
  {
    "startMs": 896000,
    "text": "this line changes this column. And here is the job that reads it."
  },
  {
    "startMs": 898790,
    "text": "is the job that reads it."
  },
  {
    "startMs": 898800,
    "text": "is the job that reads it. Second, a risk score. How severe is what"
  },
  {
    "startMs": 901829,
    "text": "Second, a risk score. How severe is what"
  },
  {
    "startMs": 901839,
    "text": "Second, a risk score. How severe is what it found. That's what drives the next"
  },
  {
    "startMs": 904230,
    "text": "it found. That's what drives the next"
  },
  {
    "startMs": 904240,
    "text": "it found. That's what drives the next step. Then it makes a call. If there is"
  },
  {
    "startMs": 907430,
    "text": "step. Then it makes a call. If there is"
  },
  {
    "startMs": 907440,
    "text": "step. Then it makes a call. If there is no serious risk, it can approve. If"
  },
  {
    "startMs": 909829,
    "text": "no serious risk, it can approve. If"
  },
  {
    "startMs": 909839,
    "text": "no serious risk, it can approve. If there is a risk that needs a person, it"
  },
  {
    "startMs": 912150,
    "text": "there is a risk that needs a person, it"
  },
  {
    "startMs": 912160,
    "text": "there is a risk that needs a person, it escalates to a human and the comments"
  },
  {
    "startMs": 914550,
    "text": "escalates to a human and the comments"
  },
  {
    "startMs": 914560,
    "text": "escalates to a human and the comments and reasoning go with it. So the person"
  },
  {
    "startMs": 917590,
    "text": "and reasoning go with it. So the person"
  },
  {
    "startMs": 917600,
    "text": "and reasoning go with it. So the person has the context to investigate instead"
  },
  {
    "startMs": 919829,
    "text": "has the context to investigate instead"
  },
  {
    "startMs": 919839,
    "text": "has the context to investigate instead of starting from scratch."
  },
  {
    "startMs": 922470,
    "text": "of starting from scratch."
  },
  {
    "startMs": 922480,
    "text": "of starting from scratch. And to be clear about what it takes to"
  },
  {
    "startMs": 924710,
    "text": "And to be clear about what it takes to"
  },
  {
    "startMs": 924720,
    "text": "And to be clear about what it takes to merge, layer 1's checks have to pass and"
  },
  {
    "startMs": 928150,
    "text": "merge, layer 1's checks have to pass and"
  },
  {
    "startMs": 928160,
    "text": "merge, layer 1's checks have to pass and the review has to approve either the"
  },
  {
    "startMs": 930389,
    "text": "the review has to approve either the"
  },
  {
    "startMs": 930399,
    "text": "the review has to approve either the agent or after an escalation a person."
  },
  {
    "startMs": 933910,
    "text": "agent or after an escalation a person."
  },
  {
    "startMs": 933920,
    "text": "agent or after an escalation a person. Both have to say yes. Now let's see what"
  },
  {
    "startMs": 936949,
    "text": "Both have to say yes. Now let's see what"
  },
  {
    "startMs": 936959,
    "text": "Both have to say yes. Now let's see what that looked like for our PR."
  },
  {
    "startMs": 940470,
    "text": "that looked like for our PR."
  },
  {
    "startMs": 940480,
    "text": "that looked like for our PR. Here is how our running PR actually"
  },
  {
    "startMs": 942310,
    "text": "Here is how our running PR actually"
  },
  {
    "startMs": 942320,
    "text": "Here is how our running PR actually ended. Same picture. The registered"
  },
  {
    "startMs": 945269,
    "text": "ended. Same picture. The registered"
  },
  {
    "startMs": 945279,
    "text": "ended. Same picture. The registered consumers look fine and the core walk"
  },
  {
    "startMs": 947990,
    "text": "consumers look fine and the core walk"
  },
  {
    "startMs": 948000,
    "text": "consumers look fine and the core walk found an unregistered job that writes"
  },
  {
    "startMs": 950389,
    "text": "found an unregistered job that writes"
  },
  {
    "startMs": 950399,
    "text": "found an unregistered job that writes our widened column into a table where it"
  },
  {
    "startMs": 952790,
    "text": "our widened column into a table where it"
  },
  {
    "startMs": 952800,
    "text": "our widened column into a table where it is still an integer"
  },
  {
    "startMs": 955269,
    "text": "is still an integer"
  },
  {
    "startMs": 955279,
    "text": "is still an integer because the agent found a real"
  },
  {
    "startMs": 956710,
    "text": "because the agent found a real"
  },
  {
    "startMs": 956720,
    "text": "because the agent found a real downstream break. It scored the risk"
  },
  {
    "startMs": 958870,
    "text": "downstream break. It scored the risk"
  },
  {
    "startMs": 958880,
    "text": "downstream break. It scored the risk high and escalated to a human with the"
  },
  {
    "startMs": 961350,
    "text": "high and escalated to a human with the"
  },
  {
    "startMs": 961360,
    "text": "high and escalated to a human with the whole chain spelled out in its review"
  },
  {
    "startMs": 963350,
    "text": "whole chain spelled out in its review"
  },
  {
    "startMs": 963360,
    "text": "whole chain spelled out in its review comment. Now the human does the part the"
  },
  {
    "startMs": 966230,
    "text": "comment. Now the human does the part the"
  },
  {
    "startMs": 966240,
    "text": "comment. Now the human does the part the agent cannot. The agent only reasons"
  },
  {
    "startMs": 969030,
    "text": "agent cannot. The agent only reasons"
  },
  {
    "startMs": 969040,
    "text": "agent cannot. The agent only reasons over the repo. It cannot see whether the"
  },
  {
    "startMs": 971430,
    "text": "over the repo. It cannot see whether the"
  },
  {
    "startMs": 971440,
    "text": "over the repo. It cannot see whether the job is actually running in production."
  },
  {
    "startMs": 973910,
    "text": "job is actually running in production."
  },
  {
    "startMs": 973920,
    "text": "job is actually running in production. human reviewer checked and confirmed"
  },
  {
    "startMs": 976069,
    "text": "human reviewer checked and confirmed"
  },
  {
    "startMs": 976079,
    "text": "human reviewer checked and confirmed that the consumer the agent found was"
  },
  {
    "startMs": 977990,
    "text": "that the consumer the agent found was"
  },
  {
    "startMs": 978000,
    "text": "that the consumer the agent found was live and active. So this was not a"
  },
  {
    "startMs": 981030,
    "text": "live and active. So this was not a"
  },
  {
    "startMs": 981040,
    "text": "live and active. So this was not a theoretical risk. The PR waited"
  },
  {
    "startMs": 985110,
    "text": "theoretical risk. The PR waited"
  },
  {
    "startMs": 985120,
    "text": "theoretical risk. The PR waited the f the fix was about order not about"
  },
  {
    "startMs": 988550,
    "text": "the f the fix was about order not about"
  },
  {
    "startMs": 988560,
    "text": "the f the fix was about order not about rejecting the change. The downstream"
  },
  {
    "startMs": 991110,
    "text": "rejecting the change. The downstream"
  },
  {
    "startMs": 991120,
    "text": "rejecting the change. The downstream table was updated first so its column"
  },
  {
    "startMs": 993590,
    "text": "table was updated first so its column"
  },
  {
    "startMs": 993600,
    "text": "table was updated first so its column could handle the wider type"
  },
  {
    "startMs": 996389,
    "text": "could handle the wider type"
  },
  {
    "startMs": 996399,
    "text": "could handle the wider type and only then did our PR merge and"
  },
  {
    "startMs": 998790,
    "text": "and only then did our PR merge and"
  },
  {
    "startMs": 998800,
    "text": "and only then did our PR merge and deploy. No incident. The scripts in"
  },
  {
    "startMs": 1001749,
    "text": "deploy. No incident. The scripts in"
  },
  {
    "startMs": 1001759,
    "text": "deploy. No incident. The scripts in layer 1 said safe. The agent found the"
  },
  {
    "startMs": 1004389,
    "text": "layer 1 said safe. The agent found the"
  },
  {
    "startMs": 1004399,
    "text": "layer 1 said safe. The agent found the gap and a human made the call."
  },
  {
    "startMs": 1009269,
    "text": "gap and a human made the call."
  },
  {
    "startMs": 1009279,
    "text": "gap and a human made the call. And that was not a one-time thing. Most"
  },
  {
    "startMs": 1011990,
    "text": "And that was not a one-time thing. Most"
  },
  {
    "startMs": 1012000,
    "text": "And that was not a one-time thing. Most changes can be cleared by the agent."
  },
  {
    "startMs": 1014150,
    "text": "changes can be cleared by the agent."
  },
  {
    "startMs": 1014160,
    "text": "changes can be cleared by the agent. When the checks pass and the agent is"
  },
  {
    "startMs": 1016069,
    "text": "When the checks pass and the agent is"
  },
  {
    "startMs": 1016079,
    "text": "When the checks pass and the agent is confident in its verdict, it approves on"
  },
  {
    "startMs": 1018230,
    "text": "confident in its verdict, it approves on"
  },
  {
    "startMs": 1018240,
    "text": "confident in its verdict, it approves on its own. But there's a whole category of"
  },
  {
    "startMs": 1020710,
    "text": "its own. But there's a whole category of"
  },
  {
    "startMs": 1020720,
    "text": "its own. But there's a whole category of changes where the agent never gets to"
  },
  {
    "startMs": 1022230,
    "text": "changes where the agent never gets to"
  },
  {
    "startMs": 1022240,
    "text": "changes where the agent never gets to say approved. And no matter how"
  },
  {
    "startMs": 1024230,
    "text": "say approved. And no matter how"
  },
  {
    "startMs": 1024240,
    "text": "say approved. And no matter how confident it sounds,"
  },
  {
    "startMs": 1026949,
    "text": "confident it sounds,"
  },
  {
    "startMs": 1026959,
    "text": "confident it sounds, grants touching sensitive data are one."
  },
  {
    "startMs": 1030150,
    "text": "grants touching sensitive data are one."
  },
  {
    "startMs": 1030160,
    "text": "grants touching sensitive data are one. Who can reach sensitive data is a"
  },
  {
    "startMs": 1031990,
    "text": "Who can reach sensitive data is a"
  },
  {
    "startMs": 1032000,
    "text": "Who can reach sensitive data is a decision we want a person to own every"
  },
  {
    "startMs": 1034309,
    "text": "decision we want a person to own every"
  },
  {
    "startMs": 1034319,
    "text": "decision we want a person to own every time."
  },
  {
    "startMs": 1036390,
    "text": "time."
  },
  {
    "startMs": 1036400,
    "text": "time. A migration that looks like it changes"
  },
  {
    "startMs": 1038470,
    "text": "A migration that looks like it changes"
  },
  {
    "startMs": 1038480,
    "text": "A migration that looks like it changes intent, not just mechanics, is another."
  },
  {
    "startMs": 1041669,
    "text": "intent, not just mechanics, is another."
  },
  {
    "startMs": 1041679,
    "text": "intent, not just mechanics, is another. If a change alters what the data means"
  },
  {
    "startMs": 1044309,
    "text": "If a change alters what the data means"
  },
  {
    "startMs": 1044319,
    "text": "If a change alters what the data means rather than just how it is moved or"
  },
  {
    "startMs": 1046390,
    "text": "rather than just how it is moved or"
  },
  {
    "startMs": 1046400,
    "text": "rather than just how it is moved or stored, a person decides."
  },
  {
    "startMs": 1050150,
    "text": "stored, a person decides."
  },
  {
    "startMs": 1050160,
    "text": "stored, a person decides. And if the agent itself is not confident"
  },
  {
    "startMs": 1052310,
    "text": "And if the agent itself is not confident"
  },
  {
    "startMs": 1052320,
    "text": "And if the agent itself is not confident in its own verdict, that's the third. It"
  },
  {
    "startMs": 1055430,
    "text": "in its own verdict, that's the third. It"
  },
  {
    "startMs": 1055440,
    "text": "in its own verdict, that's the third. It does not get to round up to approve just"
  },
  {
    "startMs": 1057350,
    "text": "does not get to round up to approve just"
  },
  {
    "startMs": 1057360,
    "text": "does not get to round up to approve just because nothing concrete came back"
  },
  {
    "startMs": 1059190,
    "text": "because nothing concrete came back"
  },
  {
    "startMs": 1059200,
    "text": "because nothing concrete came back wrong. In all the all the three cases,"
  },
  {
    "startMs": 1062710,
    "text": "wrong. In all the all the three cases,"
  },
  {
    "startMs": 1062720,
    "text": "wrong. In all the all the three cases, its job is only able to surface the risk"
  },
  {
    "startMs": 1065270,
    "text": "its job is only able to surface the risk"
  },
  {
    "startMs": 1065280,
    "text": "its job is only able to surface the risk and its reasoning. The decision stays"
  },
  {
    "startMs": 1067909,
    "text": "and its reasoning. The decision stays"
  },
  {
    "startMs": 1067919,
    "text": "and its reasoning. The decision stays with a person."
  },
  {
    "startMs": 1070390,
    "text": "with a person."
  },
  {
    "startMs": 1070400,
    "text": "with a person. That is one PR. Now, how does this hold"
  },
  {
    "startMs": 1073350,
    "text": "That is one PR. Now, how does this hold"
  },
  {
    "startMs": 1073360,
    "text": "That is one PR. Now, how does this hold up across every PR we see? And how does"
  },
  {
    "startMs": 1075750,
    "text": "up across every PR we see? And how does"
  },
  {
    "startMs": 1075760,
    "text": "up across every PR we see? And how does the reviewer get better over time?"
  },
  {
    "startMs": 1079669,
    "text": "the reviewer get better over time?"
  },
  {
    "startMs": 1079679,
    "text": "the reviewer get better over time? How do we know the flags are useful or"
  },
  {
    "startMs": 1081990,
    "text": "How do we know the flags are useful or"
  },
  {
    "startMs": 1082000,
    "text": "How do we know the flags are useful or whether a rule change helps? We start"
  },
  {
    "startMs": 1085270,
    "text": "whether a rule change helps? We start"
  },
  {
    "startMs": 1085280,
    "text": "whether a rule change helps? We start with the agents verdict and its"
  },
  {
    "startMs": 1086950,
    "text": "with the agents verdict and its"
  },
  {
    "startMs": 1086960,
    "text": "with the agents verdict and its reasoning in the review comments."
  },
  {
    "startMs": 1089590,
    "text": "reasoning in the review comments."
  },
  {
    "startMs": 1089600,
    "text": "reasoning in the review comments. A person replies agreeing or disagreeing"
  },
  {
    "startMs": 1092390,
    "text": "A person replies agreeing or disagreeing"
  },
  {
    "startMs": 1092400,
    "text": "A person replies agreeing or disagreeing and explaining why. That explanation is"
  },
  {
    "startMs": 1095190,
    "text": "and explaining why. That explanation is"
  },
  {
    "startMs": 1095200,
    "text": "and explaining why. That explanation is what makes the feedback useful rather"
  },
  {
    "startMs": 1097350,
    "text": "what makes the feedback useful rather"
  },
  {
    "startMs": 1097360,
    "text": "what makes the feedback useful rather than just a vote."
  },
  {
    "startMs": 1099750,
    "text": "than just a vote."
  },
  {
    "startMs": 1099760,
    "text": "than just a vote. Those replies are collected every day."
  },
  {
    "startMs": 1103270,
    "text": "Those replies are collected every day."
  },
  {
    "startMs": 1103280,
    "text": "Those replies are collected every day. Once a week, the on call reads the"
  },
  {
    "startMs": 1105270,
    "text": "Once a week, the on call reads the"
  },
  {
    "startMs": 1105280,
    "text": "Once a week, the on call reads the feedback and updates the review rules by"
  },
  {
    "startMs": 1107510,
    "text": "feedback and updates the review rules by"
  },
  {
    "startMs": 1107520,
    "text": "feedback and updates the review rules by hand. Those rules shape the next review."
  },
  {
    "startMs": 1111110,
    "text": "hand. Those rules shape the next review."
  },
  {
    "startMs": 1111120,
    "text": "hand. Those rules shape the next review. I know this is manual today. Nothing"
  },
  {
    "startMs": 1113669,
    "text": "I know this is manual today. Nothing"
  },
  {
    "startMs": 1113679,
    "text": "I know this is manual today. Nothing retrains itself and no rule changes"
  },
  {
    "startMs": 1115830,
    "text": "retrains itself and no rule changes"
  },
  {
    "startMs": 1115840,
    "text": "retrains itself and no rule changes automatically. But we have an idea to"
  },
  {
    "startMs": 1118310,
    "text": "automatically. But we have an idea to"
  },
  {
    "startMs": 1118320,
    "text": "automatically. But we have an idea to let an incident investigation agent help"
  },
  {
    "startMs": 1121110,
    "text": "let an incident investigation agent help"
  },
  {
    "startMs": 1121120,
    "text": "let an incident investigation agent help with that weekly pass. But it is not"
  },
  {
    "startMs": 1123270,
    "text": "with that weekly pass. But it is not"
  },
  {
    "startMs": 1123280,
    "text": "with that weekly pass. But it is not built. Without the feedback, every rule"
  },
  {
    "startMs": 1126310,
    "text": "built. Without the feedback, every rule"
  },
  {
    "startMs": 1126320,
    "text": "built. Without the feedback, every rule change would be a guess. So let me show"
  },
  {
    "startMs": 1128710,
    "text": "change would be a guess. So let me show"
  },
  {
    "startMs": 1128720,
    "text": "change would be a guess. So let me show you an example where a human corrected"
  },
  {
    "startMs": 1130789,
    "text": "you an example where a human corrected"
  },
  {
    "startMs": 1130799,
    "text": "you an example where a human corrected the agent and we use that feedback to"
  },
  {
    "startMs": 1133669,
    "text": "the agent and we use that feedback to"
  },
  {
    "startMs": 1133679,
    "text": "the agent and we use that feedback to improve its next review."
  },
  {
    "startMs": 1137590,
    "text": "improve its next review."
  },
  {
    "startMs": 1137600,
    "text": "improve its next review. So here's a real one. And note the label"
  },
  {
    "startMs": 1140390,
    "text": "So here's a real one. And note the label"
  },
  {
    "startMs": 1140400,
    "text": "So here's a real one. And note the label in the corner. This is a separate"
  },
  {
    "startMs": 1142630,
    "text": "in the corner. This is a separate"
  },
  {
    "startMs": 1142640,
    "text": "in the corner. This is a separate example, not our schema change PR."
  },
  {
    "startMs": 1146390,
    "text": "example, not our schema change PR."
  },
  {
    "startMs": 1146400,
    "text": "example, not our schema change PR. A column was marked as personal"
  },
  {
    "startMs": 1148390,
    "text": "A column was marked as personal"
  },
  {
    "startMs": 1148400,
    "text": "A column was marked as personal information in the source database."
  },
  {
    "startMs": 1150950,
    "text": "information in the source database."
  },
  {
    "startMs": 1150960,
    "text": "information in the source database. But by the time it lands in the data"
  },
  {
    "startMs": 1152710,
    "text": "But by the time it lands in the data"
  },
  {
    "startMs": 1152720,
    "text": "But by the time it lands in the data lake, the injection pipeline has already"
  },
  {
    "startMs": 1154710,
    "text": "lake, the injection pipeline has already"
  },
  {
    "startMs": 1154720,
    "text": "lake, the injection pipeline has already encrypted it. So the PR proposed"
  },
  {
    "startMs": 1157350,
    "text": "encrypted it. So the PR proposed"
  },
  {
    "startMs": 1157360,
    "text": "encrypted it. So the PR proposed labeling it nonsensitive in the data"
  },
  {
    "startMs": 1159669,
    "text": "labeling it nonsensitive in the data"
  },
  {
    "startMs": 1159679,
    "text": "labeling it nonsensitive in the data lake even though the upstream data is"
  },
  {
    "startMs": 1161669,
    "text": "lake even though the upstream data is"
  },
  {
    "startMs": 1161679,
    "text": "lake even though the upstream data is still PII."
  },
  {
    "startMs": 1163830,
    "text": "still PII."
  },
  {
    "startMs": 1163840,
    "text": "still PII. The agent flagged this. From where it"
  },
  {
    "startMs": 1166470,
    "text": "The agent flagged this. From where it"
  },
  {
    "startMs": 1166480,
    "text": "The agent flagged this. From where it stood, the upstream says PII, so a"
  },
  {
    "startMs": 1168950,
    "text": "stood, the upstream says PII, so a"
  },
  {
    "startMs": 1168960,
    "text": "stood, the upstream says PII, so a nonsensitive label looked wrong. The"
  },
  {
    "startMs": 1171830,
    "text": "nonsensitive label looked wrong. The"
  },
  {
    "startMs": 1171840,
    "text": "nonsensitive label looked wrong. The author pushed back and asked the agent"
  },
  {
    "startMs": 1174150,
    "text": "author pushed back and asked the agent"
  },
  {
    "startMs": 1174160,
    "text": "author pushed back and asked the agent to look at how similar columns on the"
  },
  {
    "startMs": 1175750,
    "text": "to look at how similar columns on the"
  },
  {
    "startMs": 1175760,
    "text": "to look at how similar columns on the other tables were already classified"
  },
  {
    "startMs": 1177990,
    "text": "other tables were already classified"
  },
  {
    "startMs": 1178000,
    "text": "other tables were already classified instead of going purely off the upstream"
  },
  {
    "startMs": 1180310,
    "text": "instead of going purely off the upstream"
  },
  {
    "startMs": 1180320,
    "text": "instead of going purely off the upstream tagging."
  },
  {
    "startMs": 1182630,
    "text": "tagging."
  },
  {
    "startMs": 1182640,
    "text": "tagging. A human agreed with the author. The"
  },
  {
    "startMs": 1185270,
    "text": "A human agreed with the author. The"
  },
  {
    "startMs": 1185280,
    "text": "A human agreed with the author. The encryption before write made the"
  },
  {
    "startMs": 1186870,
    "text": "encryption before write made the"
  },
  {
    "startMs": 1186880,
    "text": "encryption before write made the nonsensitive label look okay for this"
  },
  {
    "startMs": 1189110,
    "text": "nonsensitive label look okay for this"
  },
  {
    "startMs": 1189120,
    "text": "nonsensitive label look okay for this column. And that kind of correction is"
  },
  {
    "startMs": 1191750,
    "text": "column. And that kind of correction is"
  },
  {
    "startMs": 1191760,
    "text": "column. And that kind of correction is exactly the signal that teaches the"
  },
  {
    "startMs": 1193830,
    "text": "exactly the signal that teaches the"
  },
  {
    "startMs": 1193840,
    "text": "exactly the signal that teaches the rules to get smarter because the next"
  },
  {
    "startMs": 1196310,
    "text": "rules to get smarter because the next"
  },
  {
    "startMs": 1196320,
    "text": "rules to get smarter because the next time a similar column comes through that"
  },
  {
    "startMs": 1198710,
    "text": "time a similar column comes through that"
  },
  {
    "startMs": 1198720,
    "text": "time a similar column comes through that context can stop a needless escalation."
  },
  {
    "startMs": 1202630,
    "text": "context can stop a needless escalation."
  },
  {
    "startMs": 1202640,
    "text": "context can stop a needless escalation. One caution though, this depends on the"
  },
  {
    "startMs": 1204870,
    "text": "One caution though, this depends on the"
  },
  {
    "startMs": 1204880,
    "text": "One caution though, this depends on the specific pipeline encrypting before the"
  },
  {
    "startMs": 1207029,
    "text": "specific pipeline encrypting before the"
  },
  {
    "startMs": 1207039,
    "text": "specific pipeline encrypting before the right. It's not a blanket rule that"
  },
  {
    "startMs": 1209029,
    "text": "right. It's not a blanket rule that"
  },
  {
    "startMs": 1209039,
    "text": "right. It's not a blanket rule that encryption always makes data"
  },
  {
    "startMs": 1211029,
    "text": "encryption always makes data"
  },
  {
    "startMs": 1211039,
    "text": "encryption always makes data nonsensitive."
  },
  {
    "startMs": 1214640,
    "text": "So how do we know whether the reviewer"
  },
  {
    "startMs": 1216230,
    "text": "So how do we know whether the reviewer"
  },
  {
    "startMs": 1216240,
    "text": "So how do we know whether the reviewer is actually doing a good job?"
  },
  {
    "startMs": 1218630,
    "text": "is actually doing a good job?"
  },
  {
    "startMs": 1218640,
    "text": "is actually doing a good job? We look at two kinds of mistakes. Bad"
  },
  {
    "startMs": 1221430,
    "text": "We look at two kinds of mistakes. Bad"
  },
  {
    "startMs": 1221440,
    "text": "We look at two kinds of mistakes. Bad PRs it approved and fine PRs it"
  },
  {
    "startMs": 1224230,
    "text": "PRs it approved and fine PRs it"
  },
  {
    "startMs": 1224240,
    "text": "PRs it approved and fine PRs it unnecessarily send to a person. That"
  },
  {
    "startMs": 1227270,
    "text": "unnecessarily send to a person. That"
  },
  {
    "startMs": 1227280,
    "text": "unnecessarily send to a person. That matrix separates four possibilities."
  },
  {
    "startMs": 1231350,
    "text": "matrix separates four possibilities."
  },
  {
    "startMs": 1231360,
    "text": "matrix separates four possibilities. A fine PR approved and a bad PR"
  },
  {
    "startMs": 1233430,
    "text": "A fine PR approved and a bad PR"
  },
  {
    "startMs": 1233440,
    "text": "A fine PR approved and a bad PR escalated are the two correct outcomes."
  },
  {
    "startMs": 1236789,
    "text": "escalated are the two correct outcomes."
  },
  {
    "startMs": 1236799,
    "text": "escalated are the two correct outcomes. A bad PR approved is a miss. That's"
  },
  {
    "startMs": 1239830,
    "text": "A bad PR approved is a miss. That's"
  },
  {
    "startMs": 1239840,
    "text": "A bad PR approved is a miss. That's dangerous because the change ships."
  },
  {
    "startMs": 1242710,
    "text": "dangerous because the change ships."
  },
  {
    "startMs": 1242720,
    "text": "dangerous because the change ships. A fine PR escalated is a false"
  },
  {
    "startMs": 1244870,
    "text": "A fine PR escalated is a false"
  },
  {
    "startMs": 1244880,
    "text": "A fine PR escalated is a false escalation that costs a person's time. A"
  },
  {
    "startMs": 1248870,
    "text": "escalation that costs a person's time. A"
  },
  {
    "startMs": 1248880,
    "text": "escalation that costs a person's time. A gate that escalates everything may avoid"
  },
  {
    "startMs": 1251190,
    "text": "gate that escalates everything may avoid"
  },
  {
    "startMs": 1251200,
    "text": "gate that escalates everything may avoid misses, but it has not reduced the"
  },
  {
    "startMs": 1253350,
    "text": "misses, but it has not reduced the"
  },
  {
    "startMs": 1253360,
    "text": "misses, but it has not reduced the review load."
  },
  {
    "startMs": 1255990,
    "text": "review load."
  },
  {
    "startMs": 1256000,
    "text": "review load. As of August 31st, 2026, our miss rate"
  },
  {
    "startMs": 1258630,
    "text": "As of August 31st, 2026, our miss rate"
  },
  {
    "startMs": 1258640,
    "text": "As of August 31st, 2026, our miss rate was about 2%."
  },
  {
    "startMs": 1261669,
    "text": "was about 2%."
  },
  {
    "startMs": 1261679,
    "text": "was about 2%. Mostly from the gaps in the rules rather"
  },
  {
    "startMs": 1263590,
    "text": "Mostly from the gaps in the rules rather"
  },
  {
    "startMs": 1263600,
    "text": "Mostly from the gaps in the rules rather than the failures of the judgment. We"
  },
  {
    "startMs": 1266149,
    "text": "than the failures of the judgment. We"
  },
  {
    "startMs": 1266159,
    "text": "than the failures of the judgment. We don't have a clean single false"
  },
  {
    "startMs": 1267669,
    "text": "don't have a clean single false"
  },
  {
    "startMs": 1267679,
    "text": "don't have a clean single false escalation number. But the dominant"
  },
  {
    "startMs": 1269990,
    "text": "escalation number. But the dominant"
  },
  {
    "startMs": 1270000,
    "text": "escalation number. But the dominant cause is missing context like the"
  },
  {
    "startMs": 1271990,
    "text": "cause is missing context like the"
  },
  {
    "startMs": 1272000,
    "text": "cause is missing context like the encrypted column example that I just"
  },
  {
    "startMs": 1274070,
    "text": "encrypted column example that I just"
  },
  {
    "startMs": 1274080,
    "text": "encrypted column example that I just gave you."
  },
  {
    "startMs": 1276310,
    "text": "gave you."
  },
  {
    "startMs": 1276320,
    "text": "gave you. Misses give us new rules and false"
  },
  {
    "startMs": 1278710,
    "text": "Misses give us new rules and false"
  },
  {
    "startMs": 1278720,
    "text": "Misses give us new rules and false escalation show us context the reviewer"
  },
  {
    "startMs": 1280950,
    "text": "escalation show us context the reviewer"
  },
  {
    "startMs": 1280960,
    "text": "escalation show us context the reviewer needs. So here is one of those misses."
  },
  {
    "startMs": 1284070,
    "text": "needs. So here is one of those misses."
  },
  {
    "startMs": 1284080,
    "text": "needs. So here is one of those misses. Again know the label. This is a separate"
  },
  {
    "startMs": 1286230,
    "text": "Again know the label. This is a separate"
  },
  {
    "startMs": 1286240,
    "text": "Again know the label. This is a separate example, not our schema change PR."
  },
  {
    "startMs": 1289830,
    "text": "example, not our schema change PR."
  },
  {
    "startMs": 1289840,
    "text": "example, not our schema change PR. We have an open copy of the sum of some"
  },
  {
    "startMs": 1292070,
    "text": "We have an open copy of the sum of some"
  },
  {
    "startMs": 1292080,
    "text": "We have an open copy of the sum of some data. some of its columns are about to"
  },
  {
    "startMs": 1294870,
    "text": "data. some of its columns are about to"
  },
  {
    "startMs": 1294880,
    "text": "data. some of its columns are about to be rettagged and there is a downstream"
  },
  {
    "startMs": 1297029,
    "text": "be rettagged and there is a downstream"
  },
  {
    "startMs": 1297039,
    "text": "be rettagged and there is a downstream reader that reads those columns from the"
  },
  {
    "startMs": 1299029,
    "text": "reader that reads those columns from the"
  },
  {
    "startMs": 1299039,
    "text": "reader that reads those columns from the open copy."
  },
  {
    "startMs": 1301350,
    "text": "open copy."
  },
  {
    "startMs": 1301360,
    "text": "open copy. Privacy retag those columns as personal"
  },
  {
    "startMs": 1303830,
    "text": "Privacy retag those columns as personal"
  },
  {
    "startMs": 1303840,
    "text": "Privacy retag those columns as personal information. When that happens, they"
  },
  {
    "startMs": 1306549,
    "text": "information. When that happens, they"
  },
  {
    "startMs": 1306559,
    "text": "information. When that happens, they move into a more restricted copy of the"
  },
  {
    "startMs": 1308789,
    "text": "move into a more restricted copy of the"
  },
  {
    "startMs": 1308799,
    "text": "move into a more restricted copy of the data and they are gone from the open"
  },
  {
    "startMs": 1310630,
    "text": "data and they are gone from the open"
  },
  {
    "startMs": 1310640,
    "text": "data and they are gone from the open copy."
  },
  {
    "startMs": 1312310,
    "text": "copy."
  },
  {
    "startMs": 1312320,
    "text": "copy. The retag looked fine and it merged. But"
  },
  {
    "startMs": 1315510,
    "text": "The retag looked fine and it merged. But"
  },
  {
    "startMs": 1315520,
    "text": "The retag looked fine and it merged. But what nobody checked was whether anything"
  },
  {
    "startMs": 1317430,
    "text": "what nobody checked was whether anything"
  },
  {
    "startMs": 1317440,
    "text": "what nobody checked was whether anything downstream was still reading those"
  },
  {
    "startMs": 1318950,
    "text": "downstream was still reading those"
  },
  {
    "startMs": 1318960,
    "text": "downstream was still reading those columns from the old open copy."
  },
  {
    "startMs": 1321350,
    "text": "columns from the old open copy."
  },
  {
    "startMs": 1321360,
    "text": "columns from the old open copy. something was. And once the columns were"
  },
  {
    "startMs": 1323750,
    "text": "something was. And once the columns were"
  },
  {
    "startMs": 1323760,
    "text": "something was. And once the columns were gone, that reader broke. That's a miss."
  },
  {
    "startMs": 1327190,
    "text": "gone, that reader broke. That's a miss."
  },
  {
    "startMs": 1327200,
    "text": "gone, that reader broke. That's a miss. A PR that should have been escalated got"
  },
  {
    "startMs": 1329510,
    "text": "A PR that should have been escalated got"
  },
  {
    "startMs": 1329520,
    "text": "A PR that should have been escalated got approved."
  },
  {
    "startMs": 1331510,
    "text": "approved."
  },
  {
    "startMs": 1331520,
    "text": "approved. It wasn't a failure of judgment. It was"
  },
  {
    "startMs": 1333590,
    "text": "It wasn't a failure of judgment. It was"
  },
  {
    "startMs": 1333600,
    "text": "It wasn't a failure of judgment. It was a gap in the rules. A coroner case"
  },
  {
    "startMs": 1336149,
    "text": "a gap in the rules. A coroner case"
  },
  {
    "startMs": 1336159,
    "text": "a gap in the rules. A coroner case nobody had written down. So, it became a"
  },
  {
    "startMs": 1338710,
    "text": "nobody had written down. So, it became a"
  },
  {
    "startMs": 1338720,
    "text": "nobody had written down. So, it became a new rule. When a column gets retagged as"
  },
  {
    "startMs": 1341350,
    "text": "new rule. When a column gets retagged as"
  },
  {
    "startMs": 1341360,
    "text": "new rule. When a column gets retagged as sensitive, search the codebase for"
  },
  {
    "startMs": 1343270,
    "text": "sensitive, search the codebase for"
  },
  {
    "startMs": 1343280,
    "text": "sensitive, search the codebase for anyone still reading it from the copy"
  },
  {
    "startMs": 1345110,
    "text": "anyone still reading it from the copy"
  },
  {
    "startMs": 1345120,
    "text": "anyone still reading it from the copy that's about to lose it. And that's how"
  },
  {
    "startMs": 1347669,
    "text": "that's about to lose it. And that's how"
  },
  {
    "startMs": 1347679,
    "text": "that's about to lose it. And that's how the rules get better. the misses get"
  },
  {
    "startMs": 1350310,
    "text": "the rules get better. the misses get"
  },
  {
    "startMs": 1350320,
    "text": "the rules get better. the misses get found and get turned into new rules."
  },
  {
    "startMs": 1354630,
    "text": "found and get turned into new rules."
  },
  {
    "startMs": 1354640,
    "text": "found and get turned into new rules. So let's pull it all together. You"
  },
  {
    "startMs": 1357350,
    "text": "So let's pull it all together. You"
  },
  {
    "startMs": 1357360,
    "text": "So let's pull it all together. You remember the pull request from the"
  },
  {
    "startMs": 1358710,
    "text": "remember the pull request from the"
  },
  {
    "startMs": 1358720,
    "text": "remember the pull request from the start, the one that was green in CI."
  },
  {
    "startMs": 1361990,
    "text": "start, the one that was green in CI."
  },
  {
    "startMs": 1362000,
    "text": "start, the one that was green in CI. Three things happened to it."
  },
  {
    "startMs": 1364630,
    "text": "Three things happened to it."
  },
  {
    "startMs": 1364640,
    "text": "Three things happened to it. First, scripts proved what a source of"
  },
  {
    "startMs": 1367430,
    "text": "First, scripts proved what a source of"
  },
  {
    "startMs": 1367440,
    "text": "First, scripts proved what a source of truth could prove. The contracts, the"
  },
  {
    "startMs": 1370310,
    "text": "truth could prove. The contracts, the"
  },
  {
    "startMs": 1370320,
    "text": "truth could prove. The contracts, the tags, the registered lineage and"
  },
  {
    "startMs": 1372470,
    "text": "tags, the registered lineage and"
  },
  {
    "startMs": 1372480,
    "text": "tags, the registered lineage and performance all passed."
  },
  {
    "startMs": 1374710,
    "text": "performance all passed."
  },
  {
    "startMs": 1374720,
    "text": "performance all passed. Second, the agent read the code and"
  },
  {
    "startMs": 1377110,
    "text": "Second, the agent read the code and"
  },
  {
    "startMs": 1377120,
    "text": "Second, the agent read the code and found what the scripts could not see. A"
  },
  {
    "startMs": 1379430,
    "text": "found what the scripts could not see. A"
  },
  {
    "startMs": 1379440,
    "text": "found what the scripts could not see. A job that Lineage never knew about,"
  },
  {
    "startMs": 1381510,
    "text": "job that Lineage never knew about,"
  },
  {
    "startMs": 1381520,
    "text": "job that Lineage never knew about, quietly waiting to fail on a wider"
  },
  {
    "startMs": 1383510,
    "text": "quietly waiting to fail on a wider"
  },
  {
    "startMs": 1383520,
    "text": "quietly waiting to fail on a wider column, it flagged the whole chain and"
  },
  {
    "startMs": 1385909,
    "text": "column, it flagged the whole chain and"
  },
  {
    "startMs": 1385919,
    "text": "column, it flagged the whole chain and escalated. Third, a person confirmed the"
  },
  {
    "startMs": 1389270,
    "text": "escalated. Third, a person confirmed the"
  },
  {
    "startMs": 1389280,
    "text": "escalated. Third, a person confirmed the job was live. Uh, the downstream table"
  },
  {
    "startMs": 1391350,
    "text": "job was live. Uh, the downstream table"
  },
  {
    "startMs": 1391360,
    "text": "job was live. Uh, the downstream table was fixed first and only then did the PR"
  },
  {
    "startMs": 1393990,
    "text": "was fixed first and only then did the PR"
  },
  {
    "startMs": 1394000,
    "text": "was fixed first and only then did the PR merge. No incident. And behind all of"
  },
  {
    "startMs": 1397270,
    "text": "merge. No incident. And behind all of"
  },
  {
    "startMs": 1397280,
    "text": "merge. No incident. And behind all of that, the reviewer keeps getting better"
  },
  {
    "startMs": 1400390,
    "text": "that, the reviewer keeps getting better"
  },
  {
    "startMs": 1400400,
    "text": "that, the reviewer keeps getting better because every correction a person makes"
  },
  {
    "startMs": 1402710,
    "text": "because every correction a person makes"
  },
  {
    "startMs": 1402720,
    "text": "because every correction a person makes can become a rule. These results are as"
  },
  {
    "startMs": 1405750,
    "text": "can become a rule. These results are as"
  },
  {
    "startMs": 1405760,
    "text": "can become a rule. These results are as of August 31st, 2026. So you might ask,"
  },
  {
    "startMs": 1409029,
    "text": "of August 31st, 2026. So you might ask,"
  },
  {
    "startMs": 1409039,
    "text": "of August 31st, 2026. So you might ask, Jas, does it all work?"
  },
  {
    "startMs": 1412230,
    "text": "Jas, does it all work?"
  },
  {
    "startMs": 1412240,
    "text": "Jas, does it all work? Yes, about 60% of the data pipeline PRs"
  },
  {
    "startMs": 1415430,
    "text": "Yes, about 60% of the data pipeline PRs"
  },
  {
    "startMs": 1415440,
    "text": "Yes, about 60% of the data pipeline PRs merged without a human review."
  },
  {
    "startMs": 1418070,
    "text": "merged without a human review."
  },
  {
    "startMs": 1418080,
    "text": "merged without a human review. We have seen about 75% less manual"
  },
  {
    "startMs": 1420950,
    "text": "We have seen about 75% less manual"
  },
  {
    "startMs": 1420960,
    "text": "We have seen about 75% less manual review effort. The agent specific"
  },
  {
    "startMs": 1423510,
    "text": "review effort. The agent specific"
  },
  {
    "startMs": 1423520,
    "text": "review effort. The agent specific comments and reasoning help focus the"
  },
  {
    "startMs": 1425510,
    "text": "comments and reasoning help focus the"
  },
  {
    "startMs": 1425520,
    "text": "comments and reasoning help focus the review rather than making a person"
  },
  {
    "startMs": 1427990,
    "text": "review rather than making a person"
  },
  {
    "startMs": 1428000,
    "text": "review rather than making a person reconstruct every risk from scratch."
  },
  {
    "startMs": 1431830,
    "text": "reconstruct every risk from scratch."
  },
  {
    "startMs": 1431840,
    "text": "reconstruct every risk from scratch. The time saved comes to about 132"
  },
  {
    "startMs": 1435110,
    "text": "The time saved comes to about 132"
  },
  {
    "startMs": 1435120,
    "text": "The time saved comes to about 132 engineering hours a month. Incidents"
  },
  {
    "startMs": 1437590,
    "text": "engineering hours a month. Incidents"
  },
  {
    "startMs": 1437600,
    "text": "engineering hours a month. Incidents tied to these PRs are down about 30%."
  },
  {
    "startMs": 1441909,
    "text": "tied to these PRs are down about 30%."
  },
  {
    "startMs": 1441919,
    "text": "tied to these PRs are down about 30%. And that does not mean human free"
  },
  {
    "startMs": 1443830,
    "text": "And that does not mean human free"
  },
  {
    "startMs": 1443840,
    "text": "And that does not mean human free review. The protected decisions still"
  },
  {
    "startMs": 1446470,
    "text": "review. The protected decisions still"
  },
  {
    "startMs": 1446480,
    "text": "review. The protected decisions still reach a person by design. The goal is"
  },
  {
    "startMs": 1449669,
    "text": "reach a person by design. The goal is"
  },
  {
    "startMs": 1449679,
    "text": "reach a person by design. The goal is less review work, not removing"
  },
  {
    "startMs": 1451909,
    "text": "less review work, not removing"
  },
  {
    "startMs": 1451919,
    "text": "less review work, not removing accountability. And those are the"
  },
  {
    "startMs": 1454149,
    "text": "accountability. And those are the"
  },
  {
    "startMs": 1454159,
    "text": "accountability. And those are the results. Now, let's look at the"
  },
  {
    "startMs": 1456070,
    "text": "results. Now, let's look at the"
  },
  {
    "startMs": 1456080,
    "text": "results. Now, let's look at the architecture choices we got wrong."
  },
  {
    "startMs": 1460720,
    "text": "Here is what we got wrong today. Layer 1"
  },
  {
    "startMs": 1463750,
    "text": "Here is what we got wrong today. Layer 1"
  },
  {
    "startMs": 1463760,
    "text": "Here is what we got wrong today. Layer 1 and layer 2 are separate systems"
  },
  {
    "startMs": 1466310,
    "text": "and layer 2 are separate systems"
  },
  {
    "startMs": 1466320,
    "text": "and layer 2 are separate systems triggered independently and running in"
  },
  {
    "startMs": 1468230,
    "text": "triggered independently and running in"
  },
  {
    "startMs": 1468240,
    "text": "triggered independently and running in parallel. Each produces its own result"
  },
  {
    "startMs": 1471990,
    "text": "parallel. Each produces its own result"
  },
  {
    "startMs": 1472000,
    "text": "parallel. Each produces its own result that seemed like an obvious design when"
  },
  {
    "startMs": 1473669,
    "text": "that seemed like an obvious design when"
  },
  {
    "startMs": 1473679,
    "text": "that seemed like an obvious design when we built it,"
  },
  {
    "startMs": 1475750,
    "text": "we built it,"
  },
  {
    "startMs": 1475760,
    "text": "we built it, but neither sees the others pass fail or"
  },
  {
    "startMs": 1478230,
    "text": "but neither sees the others pass fail or"
  },
  {
    "startMs": 1478240,
    "text": "but neither sees the others pass fail or outage state. Layer 2 knows what the"
  },
  {
    "startMs": 1481190,
    "text": "outage state. Layer 2 knows what the"
  },
  {
    "startMs": 1481200,
    "text": "outage state. Layer 2 knows what the scripts are configured to cover, not"
  },
  {
    "startMs": 1483750,
    "text": "scripts are configured to cover, not"
  },
  {
    "startMs": 1483760,
    "text": "scripts are configured to cover, not what happened when they ran. Merge still"
  },
  {
    "startMs": 1486870,
    "text": "what happened when they ran. Merge still"
  },
  {
    "startMs": 1486880,
    "text": "what happened when they ran. Merge still needs passing checks and an approving"
  },
  {
    "startMs": 1488789,
    "text": "needs passing checks and an approving"
  },
  {
    "startMs": 1488799,
    "text": "needs passing checks and an approving review, but no single system has a full"
  },
  {
    "startMs": 1491350,
    "text": "review, but no single system has a full"
  },
  {
    "startMs": 1491360,
    "text": "review, but no single system has a full runtime picture."
  },
  {
    "startMs": 1493750,
    "text": "runtime picture."
  },
  {
    "startMs": 1493760,
    "text": "runtime picture. The agent also cannot call live layer 1"
  },
  {
    "startMs": 1496870,
    "text": "The agent also cannot call live layer 1"
  },
  {
    "startMs": 1496880,
    "text": "The agent also cannot call live layer 1 checks. Its tools only read, search and"
  },
  {
    "startMs": 1499830,
    "text": "checks. Its tools only read, search and"
  },
  {
    "startMs": 1499840,
    "text": "checks. Its tools only read, search and list the repository files. If a judgment"
  },
  {
    "startMs": 1502549,
    "text": "list the repository files. If a judgment"
  },
  {
    "startMs": 1502559,
    "text": "list the repository files. If a judgment needs a live fact from a live production"
  },
  {
    "startMs": 1505110,
    "text": "needs a live fact from a live production"
  },
  {
    "startMs": 1505120,
    "text": "needs a live fact from a live production system, it cannot fetch that fact"
  },
  {
    "startMs": 1507350,
    "text": "system, it cannot fetch that fact"
  },
  {
    "startMs": 1507360,
    "text": "system, it cannot fetch that fact itself."
  },
  {
    "startMs": 1509510,
    "text": "itself."
  },
  {
    "startMs": 1509520,
    "text": "itself. When one site cannot finish, we wait for"
  },
  {
    "startMs": 1512230,
    "text": "When one site cannot finish, we wait for"
  },
  {
    "startMs": 1512240,
    "text": "When one site cannot finish, we wait for a human. There is no automatic fallback."
  },
  {
    "startMs": 1515430,
    "text": "a human. There is no automatic fallback."
  },
  {
    "startMs": 1515440,
    "text": "a human. There is no automatic fallback. These are current limitations and they"
  },
  {
    "startMs": 1517750,
    "text": "These are current limitations and they"
  },
  {
    "startMs": 1517760,
    "text": "These are current limitations and they motivate the proposal. On the next"
  },
  {
    "startMs": 1519430,
    "text": "motivate the proposal. On the next"
  },
  {
    "startMs": 1519440,
    "text": "motivate the proposal. On the next slide, platform team is exploring one"
  },
  {
    "startMs": 1522390,
    "text": "slide, platform team is exploring one"
  },
  {
    "startMs": 1522400,
    "text": "slide, platform team is exploring one entry point. This is a proposal and not"
  },
  {
    "startMs": 1525029,
    "text": "entry point. This is a proposal and not"
  },
  {
    "startMs": 1525039,
    "text": "entry point. This is a proposal and not what's running today. The left panel is"
  },
  {
    "startMs": 1527750,
    "text": "what's running today. The left panel is"
  },
  {
    "startMs": 1527760,
    "text": "what's running today. The left panel is the current design and the right is"
  },
  {
    "startMs": 1530070,
    "text": "the current design and the right is"
  },
  {
    "startMs": 1530080,
    "text": "the current design and the right is where we want to go. A classifier looks"
  },
  {
    "startMs": 1533110,
    "text": "where we want to go. A classifier looks"
  },
  {
    "startMs": 1533120,
    "text": "where we want to go. A classifier looks at the whole PR then decides which"
  },
  {
    "startMs": 1535350,
    "text": "at the whole PR then decides which"
  },
  {
    "startMs": 1535360,
    "text": "at the whole PR then decides which changes to review separately and which"
  },
  {
    "startMs": 1537350,
    "text": "changes to review separately and which"
  },
  {
    "startMs": 1537360,
    "text": "changes to review separately and which to review together."
  },
  {
    "startMs": 1539430,
    "text": "to review together."
  },
  {
    "startMs": 1539440,
    "text": "to review together. This is a whole PR decision, not"
  },
  {
    "startMs": 1541350,
    "text": "This is a whole PR decision, not"
  },
  {
    "startMs": 1541360,
    "text": "This is a whole PR decision, not independent routing of each file."
  },
  {
    "startMs": 1544630,
    "text": "independent routing of each file."
  },
  {
    "startMs": 1544640,
    "text": "independent routing of each file. The agent would also get the layer 1"
  },
  {
    "startMs": 1546950,
    "text": "The agent would also get the layer 1"
  },
  {
    "startMs": 1546960,
    "text": "The agent would also get the layer 1 checks as collable tools alongside its"
  },
  {
    "startMs": 1549350,
    "text": "checks as collable tools alongside its"
  },
  {
    "startMs": 1549360,
    "text": "checks as collable tools alongside its repository tools. When judgment needs a"
  },
  {
    "startMs": 1552149,
    "text": "repository tools. When judgment needs a"
  },
  {
    "startMs": 1552159,
    "text": "repository tools. When judgment needs a live fact, it could request the"
  },
  {
    "startMs": 1553990,
    "text": "live fact, it could request the"
  },
  {
    "startMs": 1554000,
    "text": "live fact, it could request the appropriate check instead of being"
  },
  {
    "startMs": 1555269,
    "text": "appropriate check instead of being"
  },
  {
    "startMs": 1555279,
    "text": "appropriate check instead of being limited to code alone."
  },
  {
    "startMs": 1558070,
    "text": "limited to code alone."
  },
  {
    "startMs": 1558080,
    "text": "limited to code alone. The aim here is one system with the"
  },
  {
    "startMs": 1560310,
    "text": "The aim here is one system with the"
  },
  {
    "startMs": 1560320,
    "text": "The aim here is one system with the whole PR in view. We haven't built this"
  },
  {
    "startMs": 1562630,
    "text": "whole PR in view. We haven't built this"
  },
  {
    "startMs": 1562640,
    "text": "whole PR in view. We haven't built this yet. So, it's a direction, not a result."
  },
  {
    "startMs": 1566230,
    "text": "yet. So, it's a direction, not a result."
  },
  {
    "startMs": 1566240,
    "text": "yet. So, it's a direction, not a result. Let me close with what we would carry"
  },
  {
    "startMs": 1568470,
    "text": "Let me close with what we would carry"
  },
  {
    "startMs": 1568480,
    "text": "Let me close with what we would carry forward."
  },
  {
    "startMs": 1570149,
    "text": "forward."
  },
  {
    "startMs": 1570159,
    "text": "forward. So, here is the whole talk in three"
  },
  {
    "startMs": 1571750,
    "text": "So, here is the whole talk in three"
  },
  {
    "startMs": 1571760,
    "text": "So, here is the whole talk in three lines."
  },
  {
    "startMs": 1573590,
    "text": "lines."
  },
  {
    "startMs": 1573600,
    "text": "lines. Deterministic evaluations. First, if"
  },
  {
    "startMs": 1576230,
    "text": "Deterministic evaluations. First, if"
  },
  {
    "startMs": 1576240,
    "text": "Deterministic evaluations. First, if something can be proven against a source"
  },
  {
    "startMs": 1577830,
    "text": "something can be proven against a source"
  },
  {
    "startMs": 1577840,
    "text": "something can be proven against a source of truth, let a script prove it. Don't"
  },
  {
    "startMs": 1580710,
    "text": "of truth, let a script prove it. Don't"
  },
  {
    "startMs": 1580720,
    "text": "of truth, let a script prove it. Don't spend a judgment call on a yes or no"
  },
  {
    "startMs": 1582549,
    "text": "spend a judgment call on a yes or no"
  },
  {
    "startMs": 1582559,
    "text": "spend a judgment call on a yes or no fact. It's not just cleaner, it's"
  },
  {
    "startMs": 1585110,
    "text": "fact. It's not just cleaner, it's"
  },
  {
    "startMs": 1585120,
    "text": "fact. It's not just cleaner, it's cheaper, too. Every fact a script proves"
  },
  {
    "startMs": 1588549,
    "text": "cheaper, too. Every fact a script proves"
  },
  {
    "startMs": 1588559,
    "text": "cheaper, too. Every fact a script proves is review work that never needs AI. So,"
  },
  {
    "startMs": 1590950,
    "text": "is review work that never needs AI. So,"
  },
  {
    "startMs": 1590960,
    "text": "is review work that never needs AI. So, the cost of running this stays down."
  },
  {
    "startMs": 1594789,
    "text": "the cost of running this stays down."
  },
  {
    "startMs": 1594799,
    "text": "the cost of running this stays down. Flag never clear. Not for every PR, but"
  },
  {
    "startMs": 1598549,
    "text": "Flag never clear. Not for every PR, but"
  },
  {
    "startMs": 1598559,
    "text": "Flag never clear. Not for every PR, but for the changes that actually scare"
  },
  {
    "startMs": 1600070,
    "text": "for the changes that actually scare"
  },
  {
    "startMs": 1600080,
    "text": "for the changes that actually scare people, like sensitive grants, migration"
  },
  {
    "startMs": 1602549,
    "text": "people, like sensitive grants, migration"
  },
  {
    "startMs": 1602559,
    "text": "people, like sensitive grants, migration intent, and low confidence verdicts."
  },
  {
    "startMs": 1605909,
    "text": "intent, and low confidence verdicts."
  },
  {
    "startMs": 1605919,
    "text": "intent, and low confidence verdicts. There, the agent's job stops at"
  },
  {
    "startMs": 1608070,
    "text": "There, the agent's job stops at"
  },
  {
    "startMs": 1608080,
    "text": "There, the agent's job stops at surfacing the risk and the reasoning"
  },
  {
    "startMs": 1610230,
    "text": "surfacing the risk and the reasoning"
  },
  {
    "startMs": 1610240,
    "text": "surfacing the risk and the reasoning behind it. The decision stays with the"
  },
  {
    "startMs": 1613029,
    "text": "behind it. The decision stays with the"
  },
  {
    "startMs": 1613039,
    "text": "behind it. The decision stays with the person every time."
  },
  {
    "startMs": 1615990,
    "text": "person every time."
  },
  {
    "startMs": 1616000,
    "text": "person every time. Count the false escalations. A gate that"
  },
  {
    "startMs": 1619029,
    "text": "Count the false escalations. A gate that"
  },
  {
    "startMs": 1619039,
    "text": "Count the false escalations. A gate that escalates everything is not actually"
  },
  {
    "startMs": 1621029,
    "text": "escalates everything is not actually"
  },
  {
    "startMs": 1621039,
    "text": "escalates everything is not actually saving anyone any time. It's just moving"
  },
  {
    "startMs": 1623909,
    "text": "saving anyone any time. It's just moving"
  },
  {
    "startMs": 1623919,
    "text": "saving anyone any time. It's just moving the work around. measure that cost the"
  },
  {
    "startMs": 1626789,
    "text": "the work around. measure that cost the"
  },
  {
    "startMs": 1626799,
    "text": "the work around. measure that cost the same way you measure a miss. So I"
  },
  {
    "startMs": 1629669,
    "text": "same way you measure a miss. So I"
  },
  {
    "startMs": 1629679,
    "text": "same way you measure a miss. So I started with a pull request that was"
  },
  {
    "startMs": 1631110,
    "text": "started with a pull request that was"
  },
  {
    "startMs": 1631120,
    "text": "started with a pull request that was green in CI and a problem PRs arriving"
  },
  {
    "startMs": 1634310,
    "text": "green in CI and a problem PRs arriving"
  },
  {
    "startMs": 1634320,
    "text": "green in CI and a problem PRs arriving at machine speed and too few people with"
  },
  {
    "startMs": 1636630,
    "text": "at machine speed and too few people with"
  },
  {
    "startMs": 1636640,
    "text": "at machine speed and too few people with the context to review them safely. We"
  },
  {
    "startMs": 1639029,
    "text": "the context to review them safely. We"
  },
  {
    "startMs": 1639039,
    "text": "the context to review them safely. We built a hybrid reviewer scripts for the"
  },
  {
    "startMs": 1641430,
    "text": "built a hybrid reviewer scripts for the"
  },
  {
    "startMs": 1641440,
    "text": "built a hybrid reviewer scripts for the facts and agent for judgment and people"
  },
  {
    "startMs": 1643990,
    "text": "facts and agent for judgment and people"
  },
  {
    "startMs": 1644000,
    "text": "facts and agent for judgment and people for the protected calls. We walked one"
  },
  {
    "startMs": 1646710,
    "text": "for the protected calls. We walked one"
  },
  {
    "startMs": 1646720,
    "text": "for the protected calls. We walked one PR through all three saw it get lighter"
  },
  {
    "startMs": 1649510,
    "text": "PR through all three saw it get lighter"
  },
  {
    "startMs": 1649520,
    "text": "PR through all three saw it get lighter without going human free and saw how it"
  },
  {
    "startMs": 1652310,
    "text": "without going human free and saw how it"
  },
  {
    "startMs": 1652320,
    "text": "without going human free and saw how it learns from the corrections. We told you"
  },
  {
    "startMs": 1654630,
    "text": "learns from the corrections. We told you"
  },
  {
    "startMs": 1654640,
    "text": "learns from the corrections. We told you what we got wrong and we left you with"
  },
  {
    "startMs": 1656710,
    "text": "what we got wrong and we left you with"
  },
  {
    "startMs": 1656720,
    "text": "what we got wrong and we left you with three lessons. Prove what you can"
  },
  {
    "startMs": 1659430,
    "text": "three lessons. Prove what you can"
  },
  {
    "startMs": 1659440,
    "text": "three lessons. Prove what you can cheaply. Flag and never clear the scary"
  },
  {
    "startMs": 1662549,
    "text": "cheaply. Flag and never clear the scary"
  },
  {
    "startMs": 1662559,
    "text": "cheaply. Flag and never clear the scary changes. And count the false"
  },
  {
    "startMs": 1664630,
    "text": "changes. And count the false"
  },
  {
    "startMs": 1664640,
    "text": "changes. And count the false escalations."
  },
  {
    "startMs": 1666549,
    "text": "escalations."
  },
  {
    "startMs": 1666559,
    "text": "escalations. So who reviews the bots? Scripts for"
  },
  {
    "startMs": 1669350,
    "text": "So who reviews the bots? Scripts for"
  },
  {
    "startMs": 1669360,
    "text": "So who reviews the bots? Scripts for everything a source of truth can prove,"
  },
  {
    "startMs": 1671430,
    "text": "everything a source of truth can prove,"
  },
  {
    "startMs": 1671440,
    "text": "everything a source of truth can prove, an agent for everything that needs"
  },
  {
    "startMs": 1673110,
    "text": "an agent for everything that needs"
  },
  {
    "startMs": 1673120,
    "text": "an agent for everything that needs context and judgment, and humans for the"
  },
  {
    "startMs": 1676310,
    "text": "context and judgment, and humans for the"
  },
  {
    "startMs": 1676320,
    "text": "context and judgment, and humans for the calls only they get to make. Thank you"
  },
  {
    "startMs": 1679269,
    "text": "calls only they get to make. Thank you"
  },
  {
    "startMs": 1679279,
    "text": "calls only they get to make. Thank you for listening."
  }
]