[
  {
    "startMs": 1120,
    "text": "Hi, I'm Chinmai and with me are Swapnika"
  },
  {
    "startMs": 4390,
    "text": "Hi, I'm Chinmai and with me are Swapnika"
  },
  {
    "startMs": 4400,
    "text": "Hi, I'm Chinmai and with me are Swapnika and Vlad. We're excited to share our"
  },
  {
    "startMs": 6550,
    "text": "and Vlad. We're excited to share our"
  },
  {
    "startMs": 6560,
    "text": "and Vlad. We're excited to share our journey as well as our learnings around"
  },
  {
    "startMs": 8710,
    "text": "journey as well as our learnings around"
  },
  {
    "startMs": 8720,
    "text": "journey as well as our learnings around building an AI on call teammate at Meta"
  },
  {
    "startMs": 11910,
    "text": "building an AI on call teammate at Meta"
  },
  {
    "startMs": 11920,
    "text": "building an AI on call teammate at Meta that now runs real on call rotations"
  },
  {
    "startMs": 14390,
    "text": "that now runs real on call rotations"
  },
  {
    "startMs": 14400,
    "text": "that now runs real on call rotations everyday and around the clock."
  },
  {
    "startMs": 17189,
    "text": "everyday and around the clock."
  },
  {
    "startMs": 17199,
    "text": "everyday and around the clock. We are part of the engineering team that"
  },
  {
    "startMs": 19109,
    "text": "We are part of the engineering team that"
  },
  {
    "startMs": 19119,
    "text": "We are part of the engineering team that builds the tooling platform and"
  },
  {
    "startMs": 21029,
    "text": "builds the tooling platform and"
  },
  {
    "startMs": 21039,
    "text": "builds the tooling platform and infrastructure for incident response on"
  },
  {
    "startMs": 24230,
    "text": "infrastructure for incident response on"
  },
  {
    "startMs": 24240,
    "text": "infrastructure for incident response on call experience and mitigations at meta."
  },
  {
    "startMs": 27349,
    "text": "call experience and mitigations at meta."
  },
  {
    "startMs": 27359,
    "text": "call experience and mitigations at meta. That space is evolving rapidly with the"
  },
  {
    "startMs": 29669,
    "text": "That space is evolving rapidly with the"
  },
  {
    "startMs": 29679,
    "text": "That space is evolving rapidly with the increase in AI capabilities."
  },
  {
    "startMs": 32870,
    "text": "increase in AI capabilities."
  },
  {
    "startMs": 32880,
    "text": "increase in AI capabilities. AI changed how fast we write code. About"
  },
  {
    "startMs": 35910,
    "text": "AI changed how fast we write code. About"
  },
  {
    "startMs": 35920,
    "text": "AI changed how fast we write code. About 3/4 of new code is now written with AI"
  },
  {
    "startMs": 38869,
    "text": "3/4 of new code is now written with AI"
  },
  {
    "startMs": 38879,
    "text": "3/4 of new code is now written with AI and more AI generated changes reach"
  },
  {
    "startMs": 41830,
    "text": "and more AI generated changes reach"
  },
  {
    "startMs": 41840,
    "text": "and more AI generated changes reach production every single day and some of"
  },
  {
    "startMs": 45190,
    "text": "production every single day and some of"
  },
  {
    "startMs": 45200,
    "text": "production every single day and some of it can cause production failures just"
  },
  {
    "startMs": 48389,
    "text": "it can cause production failures just"
  },
  {
    "startMs": 48399,
    "text": "it can cause production failures just like any other core change can."
  },
  {
    "startMs": 51270,
    "text": "like any other core change can."
  },
  {
    "startMs": 51280,
    "text": "like any other core change can. But on call did not speed up with it."
  },
  {
    "startMs": 54150,
    "text": "But on call did not speed up with it."
  },
  {
    "startMs": 54160,
    "text": "But on call did not speed up with it. High quality code can pass review and"
  },
  {
    "startMs": 56790,
    "text": "High quality code can pass review and"
  },
  {
    "startMs": 56800,
    "text": "High quality code can pass review and still break in production. And when it"
  },
  {
    "startMs": 58869,
    "text": "still break in production. And when it"
  },
  {
    "startMs": 58879,
    "text": "still break in production. And when it does, someone still gets paged at 2 a.m."
  },
  {
    "startMs": 62470,
    "text": "does, someone still gets paged at 2 a.m."
  },
  {
    "startMs": 62480,
    "text": "does, someone still gets paged at 2 a.m. The bottleneck moved from writing code"
  },
  {
    "startMs": 64469,
    "text": "The bottleneck moved from writing code"
  },
  {
    "startMs": 64479,
    "text": "The bottleneck moved from writing code to operating it in production. And on"
  },
  {
    "startMs": 68070,
    "text": "to operating it in production. And on"
  },
  {
    "startMs": 68080,
    "text": "to operating it in production. And on call is where that operational load"
  },
  {
    "startMs": 69990,
    "text": "call is where that operational load"
  },
  {
    "startMs": 70000,
    "text": "call is where that operational load lands. So we asked if AI is writing the"
  },
  {
    "startMs": 73590,
    "text": "lands. So we asked if AI is writing the"
  },
  {
    "startMs": 73600,
    "text": "lands. So we asked if AI is writing the code, can AI also help operate it?"
  },
  {
    "startMs": 79350,
    "text": "code, can AI also help operate it?"
  },
  {
    "startMs": 79360,
    "text": "code, can AI also help operate it? And we think it can. Now, let's quickly"
  },
  {
    "startMs": 82710,
    "text": "And we think it can. Now, let's quickly"
  },
  {
    "startMs": 82720,
    "text": "And we think it can. Now, let's quickly run through one of those on call pages"
  },
  {
    "startMs": 84950,
    "text": "run through one of those on call pages"
  },
  {
    "startMs": 84960,
    "text": "run through one of those on call pages with a simplified example."
  },
  {
    "startMs": 87510,
    "text": "with a simplified example."
  },
  {
    "startMs": 87520,
    "text": "with a simplified example. It's 2:00 a.m. and 12 alerts are firing."
  },
  {
    "startMs": 91510,
    "text": "It's 2:00 a.m. and 12 alerts are firing."
  },
  {
    "startMs": 91520,
    "text": "It's 2:00 a.m. and 12 alerts are firing. Same night, it can go two different"
  },
  {
    "startMs": 93109,
    "text": "Same night, it can go two different"
  },
  {
    "startMs": 93119,
    "text": "Same night, it can go two different ways. On the left is how most of us do"
  },
  {
    "startMs": 95429,
    "text": "ways. On the left is how most of us do"
  },
  {
    "startMs": 95439,
    "text": "ways. On the left is how most of us do this today. And notice we already have"
  },
  {
    "startMs": 97990,
    "text": "this today. And notice we already have"
  },
  {
    "startMs": 98000,
    "text": "this today. And notice we already have good AI. First, you sort the alerts by"
  },
  {
    "startMs": 100870,
    "text": "good AI. First, you sort the alerts by"
  },
  {
    "startMs": 100880,
    "text": "good AI. First, you sort the alerts by yourself. Checkout, payments, disk."
  },
  {
    "startMs": 103510,
    "text": "yourself. Checkout, payments, disk."
  },
  {
    "startMs": 103520,
    "text": "yourself. Checkout, payments, disk. Which one to pick first? Let's say you"
  },
  {
    "startMs": 105270,
    "text": "Which one to pick first? Let's say you"
  },
  {
    "startMs": 105280,
    "text": "Which one to pick first? Let's say you pick checkout. Then, you ask your"
  },
  {
    "startMs": 107749,
    "text": "pick checkout. Then, you ask your"
  },
  {
    "startMs": 107759,
    "text": "pick checkout. Then, you ask your assistant why P99 latency is high."
  },
  {
    "startMs": 111510,
    "text": "assistant why P99 latency is high."
  },
  {
    "startMs": 111520,
    "text": "assistant why P99 latency is high. It's genuinely useful. It pulls the"
  },
  {
    "startMs": 113350,
    "text": "It's genuinely useful. It pulls the"
  },
  {
    "startMs": 113360,
    "text": "It's genuinely useful. It pulls the metrics and finds the deployment at 149."
  },
  {
    "startMs": 116950,
    "text": "metrics and finds the deployment at 149."
  },
  {
    "startMs": 116960,
    "text": "metrics and finds the deployment at 149. And when you ask, it reads what changed"
  },
  {
    "startMs": 119590,
    "text": "And when you ask, it reads what changed"
  },
  {
    "startMs": 119600,
    "text": "And when you ask, it reads what changed and checks the runbook."
  },
  {
    "startMs": 121910,
    "text": "and checks the runbook."
  },
  {
    "startMs": 121920,
    "text": "and checks the runbook. It figured out that the time config was"
  },
  {
    "startMs": 124149,
    "text": "It figured out that the time config was"
  },
  {
    "startMs": 124159,
    "text": "It figured out that the time config was changed to a lower value. And based on"
  },
  {
    "startMs": 127350,
    "text": "changed to a lower value. And based on"
  },
  {
    "startMs": 127360,
    "text": "changed to a lower value. And based on the runbook, it suggests to roll back,"
  },
  {
    "startMs": 129589,
    "text": "the runbook, it suggests to roll back,"
  },
  {
    "startMs": 129599,
    "text": "the runbook, it suggests to roll back, which is all very helpful. However, if"
  },
  {
    "startMs": 132710,
    "text": "which is all very helpful. However, if"
  },
  {
    "startMs": 132720,
    "text": "which is all very helpful. However, if you look at the shape of it, it waited"
  },
  {
    "startMs": 134790,
    "text": "you look at the shape of it, it waited"
  },
  {
    "startMs": 134800,
    "text": "you look at the shape of it, it waited to be asked."
  },
  {
    "startMs": 136790,
    "text": "to be asked."
  },
  {
    "startMs": 136800,
    "text": "to be asked. You picked every next step. You were the"
  },
  {
    "startMs": 140070,
    "text": "You picked every next step. You were the"
  },
  {
    "startMs": 140080,
    "text": "You picked every next step. You were the glue between the questions and once it"
  },
  {
    "startMs": 143750,
    "text": "glue between the questions and once it"
  },
  {
    "startMs": 143760,
    "text": "glue between the questions and once it answered, it went dormant."
  },
  {
    "startMs": 146470,
    "text": "answered, it went dormant."
  },
  {
    "startMs": 146480,
    "text": "answered, it went dormant. At 239, you know the cause, but the roll"
  },
  {
    "startMs": 150790,
    "text": "At 239, you know the cause, but the roll"
  },
  {
    "startMs": 150800,
    "text": "At 239, you know the cause, but the roll back, the changes, and the follow-ups"
  },
  {
    "startMs": 153350,
    "text": "back, the changes, and the follow-ups"
  },
  {
    "startMs": 153360,
    "text": "back, the changes, and the follow-ups are still yours."
  },
  {
    "startMs": 155670,
    "text": "are still yours."
  },
  {
    "startMs": 155680,
    "text": "are still yours. Now, on the right, the same 12 alerts,"
  },
  {
    "startMs": 159910,
    "text": "Now, on the right, the same 12 alerts,"
  },
  {
    "startMs": 159920,
    "text": "Now, on the right, the same 12 alerts, but an AI teammate started before you"
  },
  {
    "startMs": 163030,
    "text": "but an AI teammate started before you"
  },
  {
    "startMs": 163040,
    "text": "but an AI teammate started before you woke up. It had already ranked them."
  },
  {
    "startMs": 166949,
    "text": "woke up. It had already ranked them."
  },
  {
    "startMs": 166959,
    "text": "woke up. It had already ranked them. Checkouts first, payments merged in as"
  },
  {
    "startMs": 169830,
    "text": "Checkouts first, payments merged in as"
  },
  {
    "startMs": 169840,
    "text": "Checkouts first, payments merged in as the same cause, and the other 10 handled"
  },
  {
    "startMs": 172309,
    "text": "the same cause, and the other 10 handled"
  },
  {
    "startMs": 172319,
    "text": "the same cause, and the other 10 handled separately."
  },
  {
    "startMs": 173990,
    "text": "separately."
  },
  {
    "startMs": 174000,
    "text": "separately. It read the dashboards, diff the same"
  },
  {
    "startMs": 176630,
    "text": "It read the dashboards, diff the same"
  },
  {
    "startMs": 176640,
    "text": "It read the dashboards, diff the same 149 a.m. config change, and matched two"
  },
  {
    "startMs": 179350,
    "text": "149 a.m. config change, and matched two"
  },
  {
    "startMs": 179360,
    "text": "149 a.m. config change, and matched two past incidents."
  },
  {
    "startMs": 181430,
    "text": "past incidents."
  },
  {
    "startMs": 181440,
    "text": "past incidents. You get a hypothesis, a 30-cond way to"
  },
  {
    "startMs": 184630,
    "text": "You get a hypothesis, a 30-cond way to"
  },
  {
    "startMs": 184640,
    "text": "You get a hypothesis, a 30-cond way to verify it, and a fix waiting for your"
  },
  {
    "startMs": 188229,
    "text": "verify it, and a fix waiting for your"
  },
  {
    "startMs": 188239,
    "text": "verify it, and a fix waiting for your review. At 2011, you verified it, and"
  },
  {
    "startMs": 191509,
    "text": "review. At 2011, you verified it, and"
  },
  {
    "startMs": 191519,
    "text": "review. At 2011, you verified it, and you're back to sleep. That gap is what"
  },
  {
    "startMs": 194550,
    "text": "you're back to sleep. That gap is what"
  },
  {
    "startMs": 194560,
    "text": "you're back to sleep. That gap is what this talk is about."
  },
  {
    "startMs": 198640,
    "text": "So why were you the glue?"
  },
  {
    "startMs": 201990,
    "text": "So why were you the glue?"
  },
  {
    "startMs": 202000,
    "text": "So why were you the glue? Every team was bolting automation onto"
  },
  {
    "startMs": 204309,
    "text": "Every team was bolting automation onto"
  },
  {
    "startMs": 204319,
    "text": "Every team was bolting automation onto on call, one silo at a time. An alert"
  },
  {
    "startMs": 208710,
    "text": "on call, one silo at a time. An alert"
  },
  {
    "startMs": 208720,
    "text": "on call, one silo at a time. An alert script for alerts, a triage bot for"
  },
  {
    "startMs": 211110,
    "text": "script for alerts, a triage bot for"
  },
  {
    "startMs": 211120,
    "text": "script for alerts, a triage bot for tickets, a deploy bot for deploys, a fix"
  },
  {
    "startMs": 213990,
    "text": "tickets, a deploy bot for deploys, a fix"
  },
  {
    "startMs": 214000,
    "text": "tickets, a deploy bot for deploys, a fix it agent for incidents."
  },
  {
    "startMs": 216229,
    "text": "it agent for incidents."
  },
  {
    "startMs": 216239,
    "text": "it agent for incidents. Each one solves its slice, keeps its own"
  },
  {
    "startMs": 219190,
    "text": "Each one solves its slice, keeps its own"
  },
  {
    "startMs": 219200,
    "text": "Each one solves its slice, keeps its own context, and forgets it. Now replaying"
  },
  {
    "startMs": 222149,
    "text": "context, and forgets it. Now replaying"
  },
  {
    "startMs": 222159,
    "text": "context, and forgets it. Now replaying your 2 AM page, the alert script saw P99"
  },
  {
    "startMs": 225910,
    "text": "your 2 AM page, the alert script saw P99"
  },
  {
    "startMs": 225920,
    "text": "your 2 AM page, the alert script saw P99 latency above 2 seconds. The triage bot"
  },
  {
    "startMs": 229110,
    "text": "latency above 2 seconds. The triage bot"
  },
  {
    "startMs": 229120,
    "text": "latency above 2 seconds. The triage bot saw three tickets saying checkout is"
  },
  {
    "startMs": 230710,
    "text": "saw three tickets saying checkout is"
  },
  {
    "startMs": 230720,
    "text": "saw three tickets saying checkout is slow. The deploy bot knew about a config"
  },
  {
    "startMs": 233830,
    "text": "slow. The deploy bot knew about a config"
  },
  {
    "startMs": 233840,
    "text": "slow. The deploy bot knew about a config change at 149 and the incident history"
  },
  {
    "startMs": 236470,
    "text": "change at 149 and the incident history"
  },
  {
    "startMs": 236480,
    "text": "change at 149 and the incident history had two similar past incidents. Every"
  },
  {
    "startMs": 239429,
    "text": "had two similar past incidents. Every"
  },
  {
    "startMs": 239439,
    "text": "had two similar past incidents. Every clue existed, but nothing connected"
  },
  {
    "startMs": 242710,
    "text": "clue existed, but nothing connected"
  },
  {
    "startMs": 242720,
    "text": "clue existed, but nothing connected them. So the on call became the glue"
  },
  {
    "startMs": 246789,
    "text": "them. So the on call became the glue"
  },
  {
    "startMs": 246799,
    "text": "them. So the on call became the glue exactly"
  },
  {
    "startMs": 248390,
    "text": "exactly"
  },
  {
    "startMs": 248400,
    "text": "exactly as we saw on the left side of the"
  },
  {
    "startMs": 250550,
    "text": "as we saw on the left side of the"
  },
  {
    "startMs": 250560,
    "text": "as we saw on the left side of the previous slide."
  },
  {
    "startMs": 252390,
    "text": "previous slide."
  },
  {
    "startMs": 252400,
    "text": "previous slide. Our bet was one AI teammate per rotation"
  },
  {
    "startMs": 256550,
    "text": "Our bet was one AI teammate per rotation"
  },
  {
    "startMs": 256560,
    "text": "Our bet was one AI teammate per rotation instead."
  },
  {
    "startMs": 258469,
    "text": "instead."
  },
  {
    "startMs": 258479,
    "text": "instead. One loop across every signal, one team"
  },
  {
    "startMs": 261110,
    "text": "One loop across every signal, one team"
  },
  {
    "startMs": 261120,
    "text": "One loop across every signal, one team memory that learns every shift, its own"
  },
  {
    "startMs": 263990,
    "text": "memory that learns every shift, its own"
  },
  {
    "startMs": 264000,
    "text": "memory that learns every shift, its own identity so it acts as itself and a"
  },
  {
    "startMs": 266870,
    "text": "identity so it acts as itself and a"
  },
  {
    "startMs": 266880,
    "text": "identity so it acts as itself and a human gate so you approve instead of"
  },
  {
    "startMs": 269350,
    "text": "human gate so you approve instead of"
  },
  {
    "startMs": 269360,
    "text": "human gate so you approve instead of operate."
  },
  {
    "startMs": 270870,
    "text": "operate."
  },
  {
    "startMs": 270880,
    "text": "operate. But giving one agent all that context"
  },
  {
    "startMs": 272950,
    "text": "But giving one agent all that context"
  },
  {
    "startMs": 272960,
    "text": "But giving one agent all that context and reach raises the stakes. Which is"
  },
  {
    "startMs": 275749,
    "text": "and reach raises the stakes. Which is"
  },
  {
    "startMs": 275759,
    "text": "and reach raises the stakes. Which is why autonomy has to be earned."
  },
  {
    "startMs": 280550,
    "text": "why autonomy has to be earned."
  },
  {
    "startMs": 280560,
    "text": "why autonomy has to be earned. Under the hood, the teammate or the AI"
  },
  {
    "startMs": 283590,
    "text": "Under the hood, the teammate or the AI"
  },
  {
    "startMs": 283600,
    "text": "Under the hood, the teammate or the AI teammate is the simplest agent. There is"
  },
  {
    "startMs": 286950,
    "text": "teammate is the simplest agent. There is"
  },
  {
    "startMs": 286960,
    "text": "teammate is the simplest agent. There is model using tools in a loop acting on an"
  },
  {
    "startMs": 290310,
    "text": "model using tools in a loop acting on an"
  },
  {
    "startMs": 290320,
    "text": "model using tools in a loop acting on an environment and reading the feedback."
  },
  {
    "startMs": 293110,
    "text": "environment and reading the feedback."
  },
  {
    "startMs": 293120,
    "text": "environment and reading the feedback. Everything else in this talk is what we"
  },
  {
    "startMs": 295189,
    "text": "Everything else in this talk is what we"
  },
  {
    "startMs": 295199,
    "text": "Everything else in this talk is what we built around that loop to make it safe"
  },
  {
    "startMs": 298629,
    "text": "built around that loop to make it safe"
  },
  {
    "startMs": 298639,
    "text": "built around that loop to make it safe to leave it running. And for that I will"
  },
  {
    "startMs": 301350,
    "text": "to leave it running. And for that I will"
  },
  {
    "startMs": 301360,
    "text": "to leave it running. And for that I will hand over to Swapnikai and Vlad next to"
  },
  {
    "startMs": 304150,
    "text": "hand over to Swapnikai and Vlad next to"
  },
  {
    "startMs": 304160,
    "text": "hand over to Swapnikai and Vlad next to get into the actual details of how it"
  },
  {
    "startMs": 306390,
    "text": "get into the actual details of how it"
  },
  {
    "startMs": 306400,
    "text": "get into the actual details of how it works."
  },
  {
    "startMs": 308710,
    "text": "works."
  },
  {
    "startMs": 308720,
    "text": "works. To achieve this we started with an"
  },
  {
    "startMs": 310710,
    "text": "To achieve this we started with an"
  },
  {
    "startMs": 310720,
    "text": "To achieve this we started with an autonomy ladder. Think about how you"
  },
  {
    "startMs": 312950,
    "text": "autonomy ladder. Think about how you"
  },
  {
    "startMs": 312960,
    "text": "autonomy ladder. Think about how you onboard a new engineer to on call. First"
  },
  {
    "startMs": 316150,
    "text": "onboard a new engineer to on call. First"
  },
  {
    "startMs": 316160,
    "text": "onboard a new engineer to on call. First the shadow. They investigate and suggest"
  },
  {
    "startMs": 318950,
    "text": "the shadow. They investigate and suggest"
  },
  {
    "startMs": 318960,
    "text": "the shadow. They investigate and suggest but they don't touch production. Then"
  },
  {
    "startMs": 321909,
    "text": "but they don't touch production. Then"
  },
  {
    "startMs": 321919,
    "text": "but they don't touch production. Then the pair they write the fix and another"
  },
  {
    "startMs": 324550,
    "text": "the pair they write the fix and another"
  },
  {
    "startMs": 324560,
    "text": "the pair they write the fix and another engineer approves it. With time they"
  },
  {
    "startMs": 327189,
    "text": "engineer approves it. With time they"
  },
  {
    "startMs": 327199,
    "text": "engineer approves it. With time they gain knowledge. We give our agent"
  },
  {
    "startMs": 329830,
    "text": "gain knowledge. We give our agent"
  },
  {
    "startMs": 329840,
    "text": "gain knowledge. We give our agent exactly the same ladder. At level one,"
  },
  {
    "startMs": 332710,
    "text": "exactly the same ladder. At level one,"
  },
  {
    "startMs": 332720,
    "text": "exactly the same ladder. At level one, it investigates and tells you what it"
  },
  {
    "startMs": 334629,
    "text": "it investigates and tells you what it"
  },
  {
    "startMs": 334639,
    "text": "it investigates and tells you what it found. It changes nothing. At level two,"
  },
  {
    "startMs": 337670,
    "text": "found. It changes nothing. At level two,"
  },
  {
    "startMs": 337680,
    "text": "found. It changes nothing. At level two, it acts with approval. It drafts the"
  },
  {
    "startMs": 339990,
    "text": "it acts with approval. It drafts the"
  },
  {
    "startMs": 340000,
    "text": "it acts with approval. It drafts the fix, but nothing reaches production"
  },
  {
    "startMs": 342150,
    "text": "fix, but nothing reaches production"
  },
  {
    "startMs": 342160,
    "text": "fix, but nothing reaches production until a human approves. At level three,"
  },
  {
    "startMs": 345430,
    "text": "until a human approves. At level three,"
  },
  {
    "startMs": 345440,
    "text": "until a human approves. At level three, it clears lower criticality work on its"
  },
  {
    "startMs": 347830,
    "text": "it clears lower criticality work on its"
  },
  {
    "startMs": 347840,
    "text": "it clears lower criticality work on its own and only interrupts you for what"
  },
  {
    "startMs": 350230,
    "text": "own and only interrupts you for what"
  },
  {
    "startMs": 350240,
    "text": "own and only interrupts you for what matters. High criticality work stays"
  },
  {
    "startMs": 353110,
    "text": "matters. High criticality work stays"
  },
  {
    "startMs": 353120,
    "text": "matters. High criticality work stays with humans."
  },
  {
    "startMs": 355029,
    "text": "with humans."
  },
  {
    "startMs": 355039,
    "text": "with humans. So, what earns the next run? We use a"
  },
  {
    "startMs": 358390,
    "text": "So, what earns the next run? We use a"
  },
  {
    "startMs": 358400,
    "text": "So, what earns the next run? We use a simple test. How costly is a mistake?"
  },
  {
    "startMs": 361029,
    "text": "simple test. How costly is a mistake?"
  },
  {
    "startMs": 361039,
    "text": "simple test. How costly is a mistake? And how easy is it to catch? So an"
  },
  {
    "startMs": 363749,
    "text": "And how easy is it to catch? So an"
  },
  {
    "startMs": 363759,
    "text": "And how easy is it to catch? So an action climbs only when mistakes are"
  },
  {
    "startMs": 366309,
    "text": "action climbs only when mistakes are"
  },
  {
    "startMs": 366319,
    "text": "action climbs only when mistakes are cheap. They're caught by tests, CI or"
  },
  {
    "startMs": 369749,
    "text": "cheap. They're caught by tests, CI or"
  },
  {
    "startMs": 369759,
    "text": "cheap. They're caught by tests, CI or review. And the agent already has a"
  },
  {
    "startMs": 372390,
    "text": "review. And the agent already has a"
  },
  {
    "startMs": 372400,
    "text": "review. And the agent already has a track record on that exact action."
  },
  {
    "startMs": 375110,
    "text": "track record on that exact action."
  },
  {
    "startMs": 375120,
    "text": "track record on that exact action. That's why the agent can close a noisy"
  },
  {
    "startMs": 377749,
    "text": "That's why the agent can close a noisy"
  },
  {
    "startMs": 377759,
    "text": "That's why the agent can close a noisy alert on its own while a production"
  },
  {
    "startMs": 379830,
    "text": "alert on its own while a production"
  },
  {
    "startMs": 379840,
    "text": "alert on its own while a production mitigation still waits for a human."
  },
  {
    "startMs": 384070,
    "text": "mitigation still waits for a human."
  },
  {
    "startMs": 384080,
    "text": "mitigation still waits for a human. At level one, the investigation is"
  },
  {
    "startMs": 386309,
    "text": "At level one, the investigation is"
  },
  {
    "startMs": 386319,
    "text": "At level one, the investigation is layered and stops at the first confident"
  },
  {
    "startMs": 388469,
    "text": "layered and stops at the first confident"
  },
  {
    "startMs": 388479,
    "text": "layered and stops at the first confident answer. The agent investigated the issue"
  },
  {
    "startMs": 391270,
    "text": "answer. The agent investigated the issue"
  },
  {
    "startMs": 391280,
    "text": "answer. The agent investigated the issue using the team's memory and runbook. It"
  },
  {
    "startMs": 393909,
    "text": "using the team's memory and runbook. It"
  },
  {
    "startMs": 393919,
    "text": "using the team's memory and runbook. It also shared the root cause analysis, but"
  },
  {
    "startMs": 396309,
    "text": "also shared the root cause analysis, but"
  },
  {
    "startMs": 396319,
    "text": "also shared the root cause analysis, but human had to apply the fix."
  },
  {
    "startMs": 399270,
    "text": "human had to apply the fix."
  },
  {
    "startMs": 399280,
    "text": "human had to apply the fix. At level two, it writes the fix with the"
  },
  {
    "startMs": 402710,
    "text": "At level two, it writes the fix with the"
  },
  {
    "startMs": 402720,
    "text": "At level two, it writes the fix with the root cause and a test plan. It answers"
  },
  {
    "startMs": 405510,
    "text": "root cause and a test plan. It answers"
  },
  {
    "startMs": 405520,
    "text": "root cause and a test plan. It answers reviewer's comments and fixes CI, but"
  },
  {
    "startMs": 408870,
    "text": "reviewer's comments and fixes CI, but"
  },
  {
    "startMs": 408880,
    "text": "reviewer's comments and fixes CI, but nothing reaches production until a human"
  },
  {
    "startMs": 410950,
    "text": "nothing reaches production until a human"
  },
  {
    "startMs": 410960,
    "text": "nothing reaches production until a human approves."
  },
  {
    "startMs": 412469,
    "text": "approves."
  },
  {
    "startMs": 412479,
    "text": "approves. Most drafts don't land and that's fine."
  },
  {
    "startMs": 415830,
    "text": "Most drafts don't land and that's fine."
  },
  {
    "startMs": 415840,
    "text": "Most drafts don't land and that's fine. Review is the filter. At both levels,"
  },
  {
    "startMs": 419189,
    "text": "Review is the filter. At both levels,"
  },
  {
    "startMs": 419199,
    "text": "Review is the filter. At both levels, the agent does the homework, but you"
  },
  {
    "startMs": 422070,
    "text": "the agent does the homework, but you"
  },
  {
    "startMs": 422080,
    "text": "the agent does the homework, but you still had to grade every single paper."
  },
  {
    "startMs": 424870,
    "text": "still had to grade every single paper."
  },
  {
    "startMs": 424880,
    "text": "still had to grade every single paper. The help got much better, but the tasks"
  },
  {
    "startMs": 427909,
    "text": "The help got much better, but the tasks"
  },
  {
    "startMs": 427919,
    "text": "The help got much better, but the tasks requiring human input didn't get"
  },
  {
    "startMs": 429990,
    "text": "requiring human input didn't get"
  },
  {
    "startMs": 430000,
    "text": "requiring human input didn't get smaller. Level three shrinks the pile."
  },
  {
    "startMs": 435749,
    "text": "smaller. Level three shrinks the pile."
  },
  {
    "startMs": 435759,
    "text": "smaller. Level three shrinks the pile. Look at this example. 23 items came in,"
  },
  {
    "startMs": 439350,
    "text": "Look at this example. 23 items came in,"
  },
  {
    "startMs": 439360,
    "text": "Look at this example. 23 items came in, but only three need you. On the right,"
  },
  {
    "startMs": 442870,
    "text": "but only three need you. On the right,"
  },
  {
    "startMs": 442880,
    "text": "but only three need you. On the right, the agent handled the long tail noisy"
  },
  {
    "startMs": 445430,
    "text": "the agent handled the long tail noisy"
  },
  {
    "startMs": 445440,
    "text": "the agent handled the long tail noisy alerts, duplicates, routine fixes that"
  },
  {
    "startMs": 448469,
    "text": "alerts, duplicates, routine fixes that"
  },
  {
    "startMs": 448479,
    "text": "alerts, duplicates, routine fixes that went through normal review and CI. Two"
  },
  {
    "startMs": 451510,
    "text": "went through normal review and CI. Two"
  },
  {
    "startMs": 451520,
    "text": "went through normal review and CI. Two more are still being worked. You don't"
  },
  {
    "startMs": 454070,
    "text": "more are still being worked. You don't"
  },
  {
    "startMs": 454080,
    "text": "more are still being worked. You don't have to drive each one to completion. In"
  },
  {
    "startMs": 456790,
    "text": "have to drive each one to completion. In"
  },
  {
    "startMs": 456800,
    "text": "have to drive each one to completion. In the middle is your much smaller decision"
  },
  {
    "startMs": 459350,
    "text": "the middle is your much smaller decision"
  },
  {
    "startMs": 459360,
    "text": "the middle is your much smaller decision queue. Each item makes clear what it"
  },
  {
    "startMs": 462550,
    "text": "queue. Each item makes clear what it"
  },
  {
    "startMs": 462560,
    "text": "queue. Each item makes clear what it needs from you with a run this button"
  },
  {
    "startMs": 465270,
    "text": "needs from you with a run this button"
  },
  {
    "startMs": 465280,
    "text": "needs from you with a run this button that has a call to action. And remember"
  },
  {
    "startMs": 467990,
    "text": "that has a call to action. And remember"
  },
  {
    "startMs": 468000,
    "text": "that has a call to action. And remember our 2 a.m. checkout page that still"
  },
  {
    "startMs": 470710,
    "text": "our 2 a.m. checkout page that still"
  },
  {
    "startMs": 470720,
    "text": "our 2 a.m. checkout page that still stays human owned. The agent brings the"
  },
  {
    "startMs": 473189,
    "text": "stays human owned. The agent brings the"
  },
  {
    "startMs": 473199,
    "text": "stays human owned. The agent brings the investigation. The human owns the"
  },
  {
    "startMs": 475589,
    "text": "investigation. The human owns the"
  },
  {
    "startMs": 475599,
    "text": "investigation. The human owns the critical decision. It's the new hire"
  },
  {
    "startMs": 478309,
    "text": "critical decision. It's the new hire"
  },
  {
    "startMs": 478319,
    "text": "critical decision. It's the new hire ladder again. Trusted to handle routine"
  },
  {
    "startMs": 480710,
    "text": "ladder again. Trusted to handle routine"
  },
  {
    "startMs": 480720,
    "text": "ladder again. Trusted to handle routine work. Ready with the homework when it"
  },
  {
    "startMs": 482629,
    "text": "work. Ready with the homework when it"
  },
  {
    "startMs": 482639,
    "text": "work. Ready with the homework when it needs help. Not just less work per item,"
  },
  {
    "startMs": 485909,
    "text": "needs help. Not just less work per item,"
  },
  {
    "startMs": 485919,
    "text": "needs help. Not just less work per item, but fewer items waiting on you."
  },
  {
    "startMs": 490710,
    "text": "but fewer items waiting on you."
  },
  {
    "startMs": 490720,
    "text": "but fewer items waiting on you. That board is where the work lives. But"
  },
  {
    "startMs": 493350,
    "text": "That board is where the work lives. But"
  },
  {
    "startMs": 493360,
    "text": "That board is where the work lives. But nobody stares at a board all the time,"
  },
  {
    "startMs": 495589,
    "text": "nobody stares at a board all the time,"
  },
  {
    "startMs": 495599,
    "text": "nobody stares at a board all the time, right? So the agent is also available"
  },
  {
    "startMs": 498469,
    "text": "right? So the agent is also available"
  },
  {
    "startMs": 498479,
    "text": "right? So the agent is also available across many surfaces like chat and"
  },
  {
    "startMs": 500869,
    "text": "across many surfaces like chat and"
  },
  {
    "startMs": 500879,
    "text": "across many surfaces like chat and native incident surfaces."
  },
  {
    "startMs": 503350,
    "text": "native incident surfaces."
  },
  {
    "startMs": 503360,
    "text": "native incident surfaces. At 9 every morning it posts a digest. 23"
  },
  {
    "startMs": 507510,
    "text": "At 9 every morning it posts a digest. 23"
  },
  {
    "startMs": 507520,
    "text": "At 9 every morning it posts a digest. 23 came in three need you. 18 handled. Each"
  },
  {
    "startMs": 511670,
    "text": "came in three need you. 18 handled. Each"
  },
  {
    "startMs": 511680,
    "text": "came in three need you. 18 handled. Each thing that needs you come with a"
  },
  {
    "startMs": 513829,
    "text": "thing that needs you come with a"
  },
  {
    "startMs": 513839,
    "text": "thing that needs you come with a one-click next step. So approving the"
  },
  {
    "startMs": 516389,
    "text": "one-click next step. So approving the"
  },
  {
    "startMs": 516399,
    "text": "one-click next step. So approving the quota bump takes one tap from your"
  },
  {
    "startMs": 519190,
    "text": "quota bump takes one tap from your"
  },
  {
    "startMs": 519200,
    "text": "quota bump takes one tap from your phone. The 18 it handled are summarized"
  },
  {
    "startMs": 522469,
    "text": "phone. The 18 it handled are summarized"
  },
  {
    "startMs": 522479,
    "text": "phone. The 18 it handled are summarized not listed. and the two that are still"
  },
  {
    "startMs": 525030,
    "text": "not listed. and the two that are still"
  },
  {
    "startMs": 525040,
    "text": "not listed. and the two that are still in progress tell you what it's doing"
  },
  {
    "startMs": 527030,
    "text": "in progress tell you what it's doing"
  },
  {
    "startMs": 527040,
    "text": "in progress tell you what it's doing about them. And when you want to dig in,"
  },
  {
    "startMs": 530389,
    "text": "about them. And when you want to dig in,"
  },
  {
    "startMs": 530399,
    "text": "about them. And when you want to dig in, you just reply in the thread. As you see"
  },
  {
    "startMs": 533269,
    "text": "you just reply in the thread. As you see"
  },
  {
    "startMs": 533279,
    "text": "you just reply in the thread. As you see on the right here, you open the checkout"
  },
  {
    "startMs": 535509,
    "text": "on the right here, you open the checkout"
  },
  {
    "startMs": 535519,
    "text": "on the right here, you open the checkout incident and ask for the evidence. It"
  },
  {
    "startMs": 538230,
    "text": "incident and ask for the evidence. It"
  },
  {
    "startMs": 538240,
    "text": "incident and ask for the evidence. It already has it. Errors start at 8:41, 2"
  },
  {
    "startMs": 542230,
    "text": "already has it. Errors start at 8:41, 2"
  },
  {
    "startMs": 542240,
    "text": "already has it. Errors start at 8:41, 2 minutes after a config push cut the"
  },
  {
    "startMs": 544310,
    "text": "minutes after a config push cut the"
  },
  {
    "startMs": 544320,
    "text": "minutes after a config push cut the payment client timeout. The same pattern"
  },
  {
    "startMs": 546630,
    "text": "payment client timeout. The same pattern"
  },
  {
    "startMs": 546640,
    "text": "payment client timeout. The same pattern as two past incidents. You ask a"
  },
  {
    "startMs": 549190,
    "text": "as two past incidents. You ask a"
  },
  {
    "startMs": 549200,
    "text": "as two past incidents. You ask a follow-up, is it only EU? And it answers"
  },
  {
    "startMs": 551990,
    "text": "follow-up, is it only EU? And it answers"
  },
  {
    "startMs": 552000,
    "text": "follow-up, is it only EU? And it answers with a breakdown. It drafts the role"
  },
  {
    "startMs": 554630,
    "text": "with a breakdown. It drafts the role"
  },
  {
    "startMs": 554640,
    "text": "with a breakdown. It drafts the role back. You approve it right there and"
  },
  {
    "startMs": 557110,
    "text": "back. You approve it right there and"
  },
  {
    "startMs": 557120,
    "text": "back. You approve it right there and errors start recovering. You never"
  },
  {
    "startMs": 559269,
    "text": "errors start recovering. You never"
  },
  {
    "startMs": 559279,
    "text": "errors start recovering. You never opened a dashboard and you never had to"
  },
  {
    "startMs": 561350,
    "text": "opened a dashboard and you never had to"
  },
  {
    "startMs": 561360,
    "text": "opened a dashboard and you never had to explain the context because it was"
  },
  {
    "startMs": 563430,
    "text": "explain the context because it was"
  },
  {
    "startMs": 563440,
    "text": "explain the context because it was already there. That's what a teammate"
  },
  {
    "startMs": 565509,
    "text": "already there. That's what a teammate"
  },
  {
    "startMs": 565519,
    "text": "already there. That's what a teammate feels like. A morning handoff a"
  },
  {
    "startMs": 567590,
    "text": "feels like. A morning handoff a"
  },
  {
    "startMs": 567600,
    "text": "feels like. A morning handoff a colleague you can ask."
  },
  {
    "startMs": 572080,
    "text": "Now under the hood of this AI teammate,"
  },
  {
    "startMs": 574949,
    "text": "Now under the hood of this AI teammate,"
  },
  {
    "startMs": 574959,
    "text": "Now under the hood of this AI teammate, it's AI automations. The first"
  },
  {
    "startMs": 577829,
    "text": "it's AI automations. The first"
  },
  {
    "startMs": 577839,
    "text": "it's AI automations. The first investigates on every new signal, auto"
  },
  {
    "startMs": 580949,
    "text": "investigates on every new signal, auto"
  },
  {
    "startMs": 580959,
    "text": "investigates on every new signal, auto triage classifies it, checks its"
  },
  {
    "startMs": 583750,
    "text": "triage classifies it, checks its"
  },
  {
    "startMs": 583760,
    "text": "triage classifies it, checks its criticality, and kicks off the right"
  },
  {
    "startMs": 585590,
    "text": "criticality, and kicks off the right"
  },
  {
    "startMs": 585600,
    "text": "criticality, and kicks off the right agent. An alert goes to the incident"
  },
  {
    "startMs": 588710,
    "text": "agent. An alert goes to the incident"
  },
  {
    "startMs": 588720,
    "text": "agent. An alert goes to the incident investigator, a task to the team's own"
  },
  {
    "startMs": 591430,
    "text": "investigator, a task to the team's own"
  },
  {
    "startMs": 591440,
    "text": "investigator, a task to the team's own agent, a test failure to a coding agent,"
  },
  {
    "startMs": 594949,
    "text": "agent, a test failure to a coding agent,"
  },
  {
    "startMs": 594959,
    "text": "agent, a test failure to a coding agent, a lookup to memory, and code search."
  },
  {
    "startMs": 598389,
    "text": "a lookup to memory, and code search."
  },
  {
    "startMs": 598399,
    "text": "a lookup to memory, and code search. The second keeps the system healthy."
  },
  {
    "startMs": 601430,
    "text": "The second keeps the system healthy."
  },
  {
    "startMs": 601440,
    "text": "The second keeps the system healthy. Unattended automation fails quietly. So"
  },
  {
    "startMs": 604790,
    "text": "Unattended automation fails quietly. So"
  },
  {
    "startMs": 604800,
    "text": "Unattended automation fails quietly. So on a schedule, it looks for stuck or"
  },
  {
    "startMs": 607110,
    "text": "on a schedule, it looks for stuck or"
  },
  {
    "startMs": 607120,
    "text": "on a schedule, it looks for stuck or failed runs, retrace and repairs broken"
  },
  {
    "startMs": 610389,
    "text": "failed runs, retrace and repairs broken"
  },
  {
    "startMs": 610399,
    "text": "failed runs, retrace and repairs broken schedules, and it only pages a human if"
  },
  {
    "startMs": 613430,
    "text": "schedules, and it only pages a human if"
  },
  {
    "startMs": 613440,
    "text": "schedules, and it only pages a human if it can't fix it itself."
  },
  {
    "startMs": 615829,
    "text": "it can't fix it itself."
  },
  {
    "startMs": 615839,
    "text": "it can't fix it itself. Nothing stalls silently."
  },
  {
    "startMs": 618790,
    "text": "Nothing stalls silently."
  },
  {
    "startMs": 618800,
    "text": "Nothing stalls silently. The third hands off at every shift"
  },
  {
    "startMs": 621670,
    "text": "The third hands off at every shift"
  },
  {
    "startMs": 621680,
    "text": "The third hands off at every shift change and every morning at 9, it"
  },
  {
    "startMs": 623990,
    "text": "change and every morning at 9, it"
  },
  {
    "startMs": 624000,
    "text": "change and every morning at 9, it summarizes the shift. What needs you"
  },
  {
    "startMs": 626470,
    "text": "summarizes the shift. What needs you"
  },
  {
    "startMs": 626480,
    "text": "summarizes the shift. What needs you with the fix ready and what it handled"
  },
  {
    "startMs": 628630,
    "text": "with the fix ready and what it handled"
  },
  {
    "startMs": 628640,
    "text": "with the fix ready and what it handled on its own? Posted to the team chat. Not"
  },
  {
    "startMs": 631670,
    "text": "on its own? Posted to the team chat. Not"
  },
  {
    "startMs": 631680,
    "text": "on its own? Posted to the team chat. Not only in the morning but every urgent"
  },
  {
    "startMs": 633590,
    "text": "only in the morning but every urgent"
  },
  {
    "startMs": 633600,
    "text": "only in the morning but every urgent issue that needs user attention gets"
  },
  {
    "startMs": 635990,
    "text": "issue that needs user attention gets"
  },
  {
    "startMs": 636000,
    "text": "issue that needs user attention gets notified in chat with findings and draft"
  },
  {
    "startMs": 638630,
    "text": "notified in chat with findings and draft"
  },
  {
    "startMs": 638640,
    "text": "notified in chat with findings and draft fixes. It also tags the next own call in"
  },
  {
    "startMs": 641509,
    "text": "fixes. It also tags the next own call in"
  },
  {
    "startMs": 641519,
    "text": "fixes. It also tags the next own call in the chat during handoff. But the entire"
  },
  {
    "startMs": 643910,
    "text": "the chat during handoff. But the entire"
  },
  {
    "startMs": 643920,
    "text": "the chat during handoff. But the entire cycle still continues."
  },
  {
    "startMs": 648800,
    "text": "And because it belongs to the team, it"
  },
  {
    "startMs": 651590,
    "text": "And because it belongs to the team, it"
  },
  {
    "startMs": 651600,
    "text": "And because it belongs to the team, it runs the agents and the skills the team"
  },
  {
    "startMs": 653910,
    "text": "runs the agents and the skills the team"
  },
  {
    "startMs": 653920,
    "text": "runs the agents and the skills the team already trusts. That's the slot in the"
  },
  {
    "startMs": 656470,
    "text": "already trusts. That's the slot in the"
  },
  {
    "startMs": 656480,
    "text": "already trusts. That's the slot in the middle. Bring your own agent, add your"
  },
  {
    "startMs": 659110,
    "text": "middle. Bring your own agent, add your"
  },
  {
    "startMs": 659120,
    "text": "middle. Bring your own agent, add your own skills. If a team already has an"
  },
  {
    "startMs": 661829,
    "text": "own skills. If a team already has an"
  },
  {
    "startMs": 661839,
    "text": "own skills. If a team already has an agent that has the team's runbooks and"
  },
  {
    "startMs": 664069,
    "text": "agent that has the team's runbooks and"
  },
  {
    "startMs": 664079,
    "text": "agent that has the team's runbooks and the knowledge base, the automations"
  },
  {
    "startMs": 666150,
    "text": "the knowledge base, the automations"
  },
  {
    "startMs": 666160,
    "text": "the knowledge base, the automations leverage it. Alongside that, it has our"
  },
  {
    "startMs": 668870,
    "text": "leverage it. Alongside that, it has our"
  },
  {
    "startMs": 668880,
    "text": "leverage it. Alongside that, it has our own incident investigator and a deep"
  },
  {
    "startMs": 671350,
    "text": "own incident investigator and a deep"
  },
  {
    "startMs": 671360,
    "text": "own incident investigator and a deep dive coding session."
  },
  {
    "startMs": 673829,
    "text": "dive coding session."
  },
  {
    "startMs": 673839,
    "text": "dive coding session. Work comes in from alerts, tickets,"
  },
  {
    "startMs": 677350,
    "text": "Work comes in from alerts, tickets,"
  },
  {
    "startMs": 677360,
    "text": "Work comes in from alerts, tickets, incidents, team posts, and chat. The"
  },
  {
    "startMs": 680630,
    "text": "incidents, team posts, and chat. The"
  },
  {
    "startMs": 680640,
    "text": "incidents, team posts, and chat. The agent itself is generic. What makes it"
  },
  {
    "startMs": 683269,
    "text": "agent itself is generic. What makes it"
  },
  {
    "startMs": 683279,
    "text": "agent itself is generic. What makes it good at an on call rotation is the"
  },
  {
    "startMs": 685350,
    "text": "good at an on call rotation is the"
  },
  {
    "startMs": 685360,
    "text": "good at an on call rotation is the team's agents skills, memory, and"
  },
  {
    "startMs": 688470,
    "text": "team's agents skills, memory, and"
  },
  {
    "startMs": 688480,
    "text": "team's agents skills, memory, and playbook. And every run is logged so"
  },
  {
    "startMs": 691430,
    "text": "playbook. And every run is logged so"
  },
  {
    "startMs": 691440,
    "text": "playbook. And every run is logged so anyone on the team can inspect the"
  },
  {
    "startMs": 693509,
    "text": "anyone on the team can inspect the"
  },
  {
    "startMs": 693519,
    "text": "anyone on the team can inspect the trajectory or resume the conversation."
  },
  {
    "startMs": 696790,
    "text": "trajectory or resume the conversation."
  },
  {
    "startMs": 696800,
    "text": "trajectory or resume the conversation. Now I'm handing off to my teammate Vlad"
  },
  {
    "startMs": 699430,
    "text": "Now I'm handing off to my teammate Vlad"
  },
  {
    "startMs": 699440,
    "text": "Now I'm handing off to my teammate Vlad to talk more on the shared agent."
  },
  {
    "startMs": 704720,
    "text": "An uncle agent can't belong to just a"
  },
  {
    "startMs": 707350,
    "text": "An uncle agent can't belong to just a"
  },
  {
    "startMs": 707360,
    "text": "An uncle agent can't belong to just a single person because the uncle itself"
  },
  {
    "startMs": 709430,
    "text": "single person because the uncle itself"
  },
  {
    "startMs": 709440,
    "text": "single person because the uncle itself doesn't. So it belongs to the team."
  },
  {
    "startMs": 712310,
    "text": "doesn't. So it belongs to the team."
  },
  {
    "startMs": 712320,
    "text": "doesn't. So it belongs to the team. There's one teammate per rotation on one"
  },
  {
    "startMs": 714870,
    "text": "There's one teammate per rotation on one"
  },
  {
    "startMs": 714880,
    "text": "There's one teammate per rotation on one board. Whoever is on call can ask it,"
  },
  {
    "startMs": 717509,
    "text": "board. Whoever is on call can ask it,"
  },
  {
    "startMs": 717519,
    "text": "board. Whoever is on call can ask it, correct it, or pick up its work mid"
  },
  {
    "startMs": 719190,
    "text": "correct it, or pick up its work mid"
  },
  {
    "startMs": 719200,
    "text": "correct it, or pick up its work mid investigation. It carries the team's on"
  },
  {
    "startMs": 721670,
    "text": "investigation. It carries the team's on"
  },
  {
    "startMs": 721680,
    "text": "investigation. It carries the team's on call expertise, the playbook of lure"
  },
  {
    "startMs": 723910,
    "text": "call expertise, the playbook of lure"
  },
  {
    "startMs": 723920,
    "text": "call expertise, the playbook of lure profiles and past decisions from one"
  },
  {
    "startMs": 726150,
    "text": "profiles and past decisions from one"
  },
  {
    "startMs": 726160,
    "text": "profiles and past decisions from one shift to the next one, the way a good"
  },
  {
    "startMs": 728150,
    "text": "shift to the next one, the way a good"
  },
  {
    "startMs": 728160,
    "text": "shift to the next one, the way a good handoff should. Here's what that looks"
  },
  {
    "startMs": 731030,
    "text": "handoff should. Here's what that looks"
  },
  {
    "startMs": 731040,
    "text": "handoff should. Here's what that looks like. Monday at 2 a.m., Sam is on call"
  },
  {
    "startMs": 734310,
    "text": "like. Monday at 2 a.m., Sam is on call"
  },
  {
    "startMs": 734320,
    "text": "like. Monday at 2 a.m., Sam is on call and tells it, remember, if checkout"
  },
  {
    "startMs": 736790,
    "text": "and tells it, remember, if checkout"
  },
  {
    "startMs": 736800,
    "text": "and tells it, remember, if checkout times out after a config push, roll back"
  },
  {
    "startMs": 739269,
    "text": "times out after a config push, roll back"
  },
  {
    "startMs": 739279,
    "text": "times out after a config push, roll back the config first. It saves it to the"
  },
  {
    "startMs": 741910,
    "text": "the config first. It saves it to the"
  },
  {
    "startMs": 741920,
    "text": "the config first. It saves it to the memory."
  },
  {
    "startMs": 743509,
    "text": "memory."
  },
  {
    "startMs": 743519,
    "text": "memory. Three days later, Jordan is on call,"
  },
  {
    "startMs": 745350,
    "text": "Three days later, Jordan is on call,"
  },
  {
    "startMs": 745360,
    "text": "Three days later, Jordan is on call, hits the exact same alert, and just asks"
  },
  {
    "startMs": 748550,
    "text": "hits the exact same alert, and just asks"
  },
  {
    "startMs": 748560,
    "text": "hits the exact same alert, and just asks for a fix. The agent answers with some"
  },
  {
    "startMs": 751350,
    "text": "for a fix. The agent answers with some"
  },
  {
    "startMs": 751360,
    "text": "for a fix. The agent answers with some fix, says where it came from, and has"
  },
  {
    "startMs": 754230,
    "text": "fix, says where it came from, and has"
  },
  {
    "startMs": 754240,
    "text": "fix, says where it came from, and has the roll back drafted. Teach it once,"
  },
  {
    "startMs": 756949,
    "text": "the roll back drafted. Teach it once,"
  },
  {
    "startMs": 756959,
    "text": "the roll back drafted. Teach it once, the next call gets it,"
  },
  {
    "startMs": 759590,
    "text": "the next call gets it,"
  },
  {
    "startMs": 759600,
    "text": "the next call gets it, and it accesses the team its own"
  },
  {
    "startMs": 762629,
    "text": "and it accesses the team its own"
  },
  {
    "startMs": 762639,
    "text": "and it accesses the team its own identity owned by the rotation with only"
  },
  {
    "startMs": 764870,
    "text": "identity owned by the rotation with only"
  },
  {
    "startMs": 764880,
    "text": "identity owned by the rotation with only the access the team is comfortable"
  },
  {
    "startMs": 766389,
    "text": "the access the team is comfortable"
  },
  {
    "startMs": 766399,
    "text": "the access the team is comfortable granting it."
  },
  {
    "startMs": 769670,
    "text": "granting it."
  },
  {
    "startMs": 769680,
    "text": "granting it. And it learns from every uncle shift."
  },
  {
    "startMs": 772550,
    "text": "And it learns from every uncle shift."
  },
  {
    "startMs": 772560,
    "text": "And it learns from every uncle shift. Handoffs, decisions, and corrections all"
  },
  {
    "startMs": 775030,
    "text": "Handoffs, decisions, and corrections all"
  },
  {
    "startMs": 775040,
    "text": "Handoffs, decisions, and corrections all flow into memory. So shift number 30 is"
  },
  {
    "startMs": 777910,
    "text": "flow into memory. So shift number 30 is"
  },
  {
    "startMs": 777920,
    "text": "flow into memory. So shift number 30 is better than the shift number one. The"
  },
  {
    "startMs": 779829,
    "text": "better than the shift number one. The"
  },
  {
    "startMs": 779839,
    "text": "better than the shift number one. The same way a new uncle gets better every"
  },
  {
    "startMs": 781670,
    "text": "same way a new uncle gets better every"
  },
  {
    "startMs": 781680,
    "text": "same way a new uncle gets better every week. But memory erodess over time. So"
  },
  {
    "startMs": 785670,
    "text": "week. But memory erodess over time. So"
  },
  {
    "startMs": 785680,
    "text": "week. But memory erodess over time. So ours has to earn its place. It retrieves"
  },
  {
    "startMs": 789190,
    "text": "ours has to earn its place. It retrieves"
  },
  {
    "startMs": 789200,
    "text": "ours has to earn its place. It retrieves semantically uses what it finds, scores"
  },
  {
    "startMs": 791990,
    "text": "semantically uses what it finds, scores"
  },
  {
    "startMs": 792000,
    "text": "semantically uses what it finds, scores what it actually helped, and promotes or"
  },
  {
    "startMs": 795110,
    "text": "what it actually helped, and promotes or"
  },
  {
    "startMs": 795120,
    "text": "what it actually helped, and promotes or retires entries automatically."
  },
  {
    "startMs": 797590,
    "text": "retires entries automatically."
  },
  {
    "startMs": 797600,
    "text": "retires entries automatically. When someone says that was wrong, the"
  },
  {
    "startMs": 800150,
    "text": "When someone says that was wrong, the"
  },
  {
    "startMs": 800160,
    "text": "When someone says that was wrong, the item reopens and the correction becomes"
  },
  {
    "startMs": 802150,
    "text": "item reopens and the correction becomes"
  },
  {
    "startMs": 802160,
    "text": "item reopens and the correction becomes memory."
  },
  {
    "startMs": 804870,
    "text": "memory."
  },
  {
    "startMs": 804880,
    "text": "memory. Three things made this work beyond our"
  },
  {
    "startMs": 806949,
    "text": "Three things made this work beyond our"
  },
  {
    "startMs": 806959,
    "text": "Three things made this work beyond our team."
  },
  {
    "startMs": 808470,
    "text": "team."
  },
  {
    "startMs": 808480,
    "text": "team. First, a loop that never stops"
  },
  {
    "startMs": 810550,
    "text": "First, a loop that never stops"
  },
  {
    "startMs": 810560,
    "text": "First, a loop that never stops listening. Every piece of feedback or"
  },
  {
    "startMs": 813110,
    "text": "listening. Every piece of feedback or"
  },
  {
    "startMs": 813120,
    "text": "listening. Every piece of feedback or course correction reopens the item and"
  },
  {
    "startMs": 815430,
    "text": "course correction reopens the item and"
  },
  {
    "startMs": 815440,
    "text": "course correction reopens the item and ultimately gets absorbed into memory."
  },
  {
    "startMs": 818389,
    "text": "ultimately gets absorbed into memory."
  },
  {
    "startMs": 818399,
    "text": "ultimately gets absorbed into memory. Feedback is an input to the system, not"
  },
  {
    "startMs": 820550,
    "text": "Feedback is an input to the system, not"
  },
  {
    "startMs": 820560,
    "text": "Feedback is an input to the system, not a story read once a quarter. Second,"
  },
  {
    "startMs": 824310,
    "text": "a story read once a quarter. Second,"
  },
  {
    "startMs": 824320,
    "text": "a story read once a quarter. Second, customize instead of forking. Teams"
  },
  {
    "startMs": 827750,
    "text": "customize instead of forking. Teams"
  },
  {
    "startMs": 827760,
    "text": "customize instead of forking. Teams bring their own playbooks and skill"
  },
  {
    "startMs": 829590,
    "text": "bring their own playbooks and skill"
  },
  {
    "startMs": 829600,
    "text": "bring their own playbooks and skill workflows and it's still the same"
  },
  {
    "startMs": 831670,
    "text": "workflows and it's still the same"
  },
  {
    "startMs": 831680,
    "text": "workflows and it's still the same teammate underneath."
  },
  {
    "startMs": 834069,
    "text": "teammate underneath."
  },
  {
    "startMs": 834079,
    "text": "teammate underneath. Third, what we call one rotation to end."
  },
  {
    "startMs": 838069,
    "text": "Third, what we call one rotation to end."
  },
  {
    "startMs": 838079,
    "text": "Third, what we call one rotation to end. Identity, config, and memory are per"
  },
  {
    "startMs": 840550,
    "text": "Identity, config, and memory are per"
  },
  {
    "startMs": 840560,
    "text": "Identity, config, and memory are per team. So add a rotation becomes a setup,"
  },
  {
    "startMs": 843110,
    "text": "team. So add a rotation becomes a setup,"
  },
  {
    "startMs": 843120,
    "text": "team. So add a rotation becomes a setup, not a new project. The agent is generic"
  },
  {
    "startMs": 846389,
    "text": "not a new project. The agent is generic"
  },
  {
    "startMs": 846399,
    "text": "not a new project. The agent is generic while the expertise is owned by the"
  },
  {
    "startMs": 848150,
    "text": "while the expertise is owned by the"
  },
  {
    "startMs": 848160,
    "text": "while the expertise is owned by the team."
  },
  {
    "startMs": 851110,
    "text": "team."
  },
  {
    "startMs": 851120,
    "text": "team. So what has changed for the people on"
  },
  {
    "startMs": 853030,
    "text": "So what has changed for the people on"
  },
  {
    "startMs": 853040,
    "text": "So what has changed for the people on call? Well, first their job shifted from"
  },
  {
    "startMs": 855829,
    "text": "call? Well, first their job shifted from"
  },
  {
    "startMs": 855839,
    "text": "call? Well, first their job shifted from driving deep investigations to making"
  },
  {
    "startMs": 857750,
    "text": "driving deep investigations to making"
  },
  {
    "startMs": 857760,
    "text": "driving deep investigations to making key decisions. They start from a"
  },
  {
    "startMs": 859910,
    "text": "key decisions. They start from a"
  },
  {
    "startMs": 859920,
    "text": "key decisions. They start from a hypothesis with linked evidence, not a"
  },
  {
    "startMs": 862310,
    "text": "hypothesis with linked evidence, not a"
  },
  {
    "startMs": 862320,
    "text": "hypothesis with linked evidence, not a blank task or dashboard."
  },
  {
    "startMs": 864790,
    "text": "blank task or dashboard."
  },
  {
    "startMs": 864800,
    "text": "blank task or dashboard. Second, the load is getting lighter."
  },
  {
    "startMs": 867670,
    "text": "Second, the load is getting lighter."
  },
  {
    "startMs": 867680,
    "text": "Second, the load is getting lighter. Early signs of on call load reduction"
  },
  {
    "startMs": 869990,
    "text": "Early signs of on call load reduction"
  },
  {
    "startMs": 870000,
    "text": "Early signs of on call load reduction are promising for teams that run it"
  },
  {
    "startMs": 871990,
    "text": "are promising for teams that run it"
  },
  {
    "startMs": 872000,
    "text": "are promising for teams that run it automatic autonomously and we want to"
  },
  {
    "startMs": 874470,
    "text": "automatic autonomously and we want to"
  },
  {
    "startMs": 874480,
    "text": "automatic autonomously and we want to measure it rigorously before we put a"
  },
  {
    "startMs": 876230,
    "text": "measure it rigorously before we put a"
  },
  {
    "startMs": 876240,
    "text": "measure it rigorously before we put a number on it."
  },
  {
    "startMs": 878150,
    "text": "number on it."
  },
  {
    "startMs": 878160,
    "text": "number on it. And the third, every change that agent"
  },
  {
    "startMs": 880389,
    "text": "And the third, every change that agent"
  },
  {
    "startMs": 880399,
    "text": "And the third, every change that agent writes still meets a human. Fixes land"
  },
  {
    "startMs": 883990,
    "text": "writes still meets a human. Fixes land"
  },
  {
    "startMs": 884000,
    "text": "writes still meets a human. Fixes land only through normal review and"
  },
  {
    "startMs": 885910,
    "text": "only through normal review and"
  },
  {
    "startMs": 885920,
    "text": "only through normal review and continuous integration. And most drafts"
  },
  {
    "startMs": 888310,
    "text": "continuous integration. And most drafts"
  },
  {
    "startMs": 888320,
    "text": "continuous integration. And most drafts don't land. That's the point. Review is"
  },
  {
    "startMs": 891110,
    "text": "don't land. That's the point. Review is"
  },
  {
    "startMs": 891120,
    "text": "don't land. That's the point. Review is the filter."
  },
  {
    "startMs": 892949,
    "text": "the filter."
  },
  {
    "startMs": 892959,
    "text": "the filter. Encle stops being attacks and becomes a"
  },
  {
    "startMs": 895189,
    "text": "Encle stops being attacks and becomes a"
  },
  {
    "startMs": 895199,
    "text": "Encle stops being attacks and becomes a review cue."
  },
  {
    "startMs": 897990,
    "text": "review cue."
  },
  {
    "startMs": 898000,
    "text": "review cue. Here's what we're focusing on next."
  },
  {
    "startMs": 900629,
    "text": "Here's what we're focusing on next."
  },
  {
    "startMs": 900639,
    "text": "Here's what we're focusing on next. First, mitigations that get approved,"
  },
  {
    "startMs": 902790,
    "text": "First, mitigations that get approved,"
  },
  {
    "startMs": 902800,
    "text": "First, mitigations that get approved, not just drafted. We grade every"
  },
  {
    "startMs": 904949,
    "text": "not just drafted. We grade every"
  },
  {
    "startMs": 904959,
    "text": "not just drafted. We grade every mitigation that agent proposes and feed"
  },
  {
    "startMs": 907030,
    "text": "mitigation that agent proposes and feed"
  },
  {
    "startMs": 907040,
    "text": "mitigation that agent proposes and feed the outcome back so it earns its next"
  },
  {
    "startMs": 909430,
    "text": "the outcome back so it earns its next"
  },
  {
    "startMs": 909440,
    "text": "the outcome back so it earns its next level instead of being handed it."
  },
  {
    "startMs": 911990,
    "text": "level instead of being handed it."
  },
  {
    "startMs": 912000,
    "text": "level instead of being handed it. Second, skills are written from the chat"
  },
  {
    "startMs": 914629,
    "text": "Second, skills are written from the chat"
  },
  {
    "startMs": 914639,
    "text": "Second, skills are written from the chat so a team can turn its runbooks into"
  },
  {
    "startMs": 916870,
    "text": "so a team can turn its runbooks into"
  },
  {
    "startMs": 916880,
    "text": "so a team can turn its runbooks into skills without writing any code. And"
  },
  {
    "startMs": 919670,
    "text": "skills without writing any code. And"
  },
  {
    "startMs": 919680,
    "text": "skills without writing any code. And third, measuring the time we give back"
  },
  {
    "startMs": 921910,
    "text": "third, measuring the time we give back"
  },
  {
    "startMs": 921920,
    "text": "third, measuring the time we give back properly with a rigorous study of call"
  },
  {
    "startMs": 924230,
    "text": "properly with a rigorous study of call"
  },
  {
    "startMs": 924240,
    "text": "properly with a rigorous study of call time saved rather than usage counts."
  },
  {
    "startMs": 927509,
    "text": "time saved rather than usage counts."
  },
  {
    "startMs": 927519,
    "text": "time saved rather than usage counts. And the next rung on the ladder is uh"
  },
  {
    "startMs": 930550,
    "text": "And the next rung on the ladder is uh"
  },
  {
    "startMs": 930560,
    "text": "And the next rung on the ladder is uh earning medium criticality autonomy with"
  },
  {
    "startMs": 932870,
    "text": "earning medium criticality autonomy with"
  },
  {
    "startMs": 932880,
    "text": "earning medium criticality autonomy with evidence. On that, thank you so much for"
  },
  {
    "startMs": 936069,
    "text": "evidence. On that, thank you so much for"
  },
  {
    "startMs": 936079,
    "text": "evidence. On that, thank you so much for listening to us and hopefully that was"
  },
  {
    "startMs": 938069,
    "text": "listening to us and hopefully that was"
  },
  {
    "startMs": 938079,
    "text": "listening to us and hopefully that was helpful. Bye."
  }
]