[
  {
    "startMs": 3600,
    "text": "Hi everyone, welcome to my talk about"
  },
  {
    "startMs": 5590,
    "text": "Hi everyone, welcome to my talk about"
  },
  {
    "startMs": 5600,
    "text": "Hi everyone, welcome to my talk about what happens when you detonate thousands"
  },
  {
    "startMs": 7349,
    "text": "what happens when you detonate thousands"
  },
  {
    "startMs": 7359,
    "text": "what happens when you detonate thousands of agent skills. This is a look inside"
  },
  {
    "startMs": 11110,
    "text": "of agent skills. This is a look inside"
  },
  {
    "startMs": 11120,
    "text": "of agent skills. This is a look inside our agent detonation chamber and what we"
  },
  {
    "startMs": 14310,
    "text": "our agent detonation chamber and what we"
  },
  {
    "startMs": 14320,
    "text": "our agent detonation chamber and what we saw when we put skills in there. My name"
  },
  {
    "startMs": 17189,
    "text": "saw when we put skills in there. My name"
  },
  {
    "startMs": 17199,
    "text": "saw when we put skills in there. My name is Roey. I'm a staff engineer at Zenity"
  },
  {
    "startMs": 19590,
    "text": "is Roey. I'm a staff engineer at Zenity"
  },
  {
    "startMs": 19600,
    "text": "is Roey. I'm a staff engineer at Zenity and I'm a MATS research fellow. I talk a"
  },
  {
    "startMs": 21830,
    "text": "and I'm a MATS research fellow. I talk a"
  },
  {
    "startMs": 21840,
    "text": "and I'm a MATS research fellow. I talk a lot about AI safety and security. Follow"
  },
  {
    "startMs": 24310,
    "text": "lot about AI safety and security. Follow"
  },
  {
    "startMs": 24320,
    "text": "lot about AI safety and security. Follow me on Twitter and LinkedIn."
  },
  {
    "startMs": 27029,
    "text": "me on Twitter and LinkedIn."
  },
  {
    "startMs": 27039,
    "text": "me on Twitter and LinkedIn. Before we even start our uh session, we"
  },
  {
    "startMs": 30550,
    "text": "Before we even start our uh session, we"
  },
  {
    "startMs": 30560,
    "text": "Before we even start our uh session, we need to talk about what an agent skill"
  },
  {
    "startMs": 32790,
    "text": "need to talk about what an agent skill"
  },
  {
    "startMs": 32800,
    "text": "need to talk about what an agent skill is. Well, essentially an agent skill is"
  },
  {
    "startMs": 35510,
    "text": "is. Well, essentially an agent skill is"
  },
  {
    "startMs": 35520,
    "text": "is. Well, essentially an agent skill is capability of capability on demand. It"
  },
  {
    "startMs": 38310,
    "text": "capability of capability on demand. It"
  },
  {
    "startMs": 38320,
    "text": "capability of capability on demand. It has a bunch of instructions, resources,"
  },
  {
    "startMs": 41110,
    "text": "has a bunch of instructions, resources,"
  },
  {
    "startMs": 41120,
    "text": "has a bunch of instructions, resources, new behavior. It can contain scripts and"
  },
  {
    "startMs": 43670,
    "text": "new behavior. It can contain scripts and"
  },
  {
    "startMs": 43680,
    "text": "new behavior. It can contain scripts and it can even contain code. The problem is"
  },
  {
    "startMs": 46549,
    "text": "it can even contain code. The problem is"
  },
  {
    "startMs": 46559,
    "text": "it can even contain code. The problem is that it was written by someone else. And"
  },
  {
    "startMs": 48549,
    "text": "that it was written by someone else. And"
  },
  {
    "startMs": 48559,
    "text": "that it was written by someone else. And this is exactly where the problem start."
  },
  {
    "startMs": 51110,
    "text": "this is exactly where the problem start."
  },
  {
    "startMs": 51120,
    "text": "this is exactly where the problem start. So let's take a look at the skills"
  },
  {
    "startMs": 52950,
    "text": "So let's take a look at the skills"
  },
  {
    "startMs": 52960,
    "text": "So let's take a look at the skills trajectory. For instance, if we look at"
  },
  {
    "startMs": 55750,
    "text": "trajectory. For instance, if we look at"
  },
  {
    "startMs": 55760,
    "text": "trajectory. For instance, if we look at this uh if we look at the trajectory"
  },
  {
    "startMs": 57750,
    "text": "this uh if we look at the trajectory"
  },
  {
    "startMs": 57760,
    "text": "[Editorial paraphrase] The recorded"
  },
  {
    "startMs": 59750,
    "text": "activity involved"
  },
  {
    "startMs": 59760,
    "text": "cloud configuration and"
  },
  {
    "startMs": 63510,
    "text": "identity information."
  },
  {
    "startMs": 63520,
    "text": "That caught"
  },
  {
    "startMs": 65590,
    "text": "our attention because"
  },
  {
    "startMs": 65600,
    "text": "malicious software"
  },
  {
    "startMs": 67750,
    "text": "can also access"
  },
  {
    "startMs": 67760,
    "text": "sensitive information."
  },
  {
    "startMs": 69910,
    "text": "These events"
  },
  {
    "startMs": 69920,
    "text": "establish what the"
  },
  {
    "startMs": 72630,
    "text": "program touched;"
  },
  {
    "startMs": 72640,
    "text": "the trace by"
  },
  {
    "startMs": 74310,
    "text": "itself does"
  },
  {
    "startMs": 74320,
    "text": "not tell"
  },
  {
    "startMs": 76789,
    "text": "the investigator whether"
  },
  {
    "startMs": 76799,
    "text": "that work"
  },
  {
    "startMs": 79190,
    "text": "belonged to the"
  },
  {
    "startMs": 79200,
    "text": "user's task."
  },
  {
    "startMs": 81350,
    "text": "In this"
  },
  {
    "startMs": 81360,
    "text": "case the skill"
  },
  {
    "startMs": 84390,
    "text": "was an"
  },
  {
    "startMs": 84400,
    "text": "official Azure diagnostic."
  },
  {
    "startMs": 86870,
    "text": "an official Azure diagnostic skill. And"
  },
  {
    "startMs": 86880,
    "text": "an official Azure diagnostic skill. And this is exactly the point where it's"
  },
  {
    "startMs": 88710,
    "text": "this is exactly the point where it's"
  },
  {
    "startMs": 88720,
    "text": "this is exactly the point where it's kind of hard for us to identify whether"
  },
  {
    "startMs": 90870,
    "text": "kind of hard for us to identify whether"
  },
  {
    "startMs": 90880,
    "text": "kind of hard for us to identify whether a skill is malicious or benign. And we have"
  },
  {
    "startMs": 93030,
    "text": "a skill is malicious or benign. And we have"
  },
  {
    "startMs": 93040,
    "text": "a skill is malicious or benign. And we have to understand the original intent of the"
  },
  {
    "startMs": 95030,
    "text": "to understand the original intent of the"
  },
  {
    "startMs": 95040,
    "text": "to understand the original intent of the skills according to its actions. And at"
  },
  {
    "startMs": 98230,
    "text": "skills according to its actions. And at"
  },
  {
    "startMs": 98240,
    "text": "skills according to its actions. And at this point, you might ask, okay, so we"
  },
  {
    "startMs": 99990,
    "text": "this point, you might ask, okay, so we"
  },
  {
    "startMs": 100000,
    "text": "this point, you might ask, okay, so we can just like scan the skill, right?"
  },
  {
    "startMs": 103190,
    "text": "can just like scan the skill, right?"
  },
  {
    "startMs": 103200,
    "text": "can just like scan the skill, right? Well, it's it's it's more complicated"
  },
  {
    "startMs": 105030,
    "text": "Well, it's it's it's more complicated"
  },
  {
    "startMs": 105040,
    "text": "Well, it's it's it's more complicated than that. The the first problem problem"
  },
  {
    "startMs": 107270,
    "text": "than that. The the first problem problem"
  },
  {
    "startMs": 107280,
    "text": "[Editorial paraphrase] The installed"
  },
  {
    "startMs": 109350,
    "text": "skill file"
  },
  {
    "startMs": 109360,
    "text": "can refer to"
  },
  {
    "startMs": 111590,
    "text": "material that"
  },
  {
    "startMs": 111600,
    "text": "lives somewhere else."
  },
  {
    "startMs": 113990,
    "text": "The reviewer"
  },
  {
    "startMs": 114000,
    "text": "sees what is"
  },
  {
    "startMs": 117510,
    "text": "in the"
  },
  {
    "startMs": 117520,
    "text": "original file. The"
  },
  {
    "startMs": 119990,
    "text": "agent may"
  },
  {
    "startMs": 120000,
    "text": "see different instructions,"
  },
  {
    "startMs": 122069,
    "text": "additional software"
  },
  {
    "startMs": 122079,
    "text": "or dependencies"
  },
  {
    "startMs": 124149,
    "text": "when it uses"
  },
  {
    "startMs": 124159,
    "text": "the skill."
  },
  {
    "startMs": 126789,
    "text": "A static review"
  },
  {
    "startMs": 126799,
    "text": "ends too"
  },
  {
    "startMs": 128790,
    "text": "early if it"
  },
  {
    "startMs": 128800,
    "text": "stops at"
  },
  {
    "startMs": 132070,
    "text": "the first document."
  },
  {
    "startMs": 132080,
    "text": "We need"
  },
  {
    "startMs": 134630,
    "text": "to know which"
  },
  {
    "startMs": 134640,
    "text": "material actually"
  },
  {
    "startMs": 137030,
    "text": "influenced the run."
  },
  {
    "startMs": 137040,
    "text": "you would lose all of that and you would have to create some sort of mechanism to"
  },
  {
    "startMs": 138710,
    "text": "have to create some sort of mechanism to"
  },
  {
    "startMs": 138720,
    "text": "have to create some sort of mechanism to track all of these payloads if you don't"
  },
  {
    "startMs": 140550,
    "text": "track all of these payloads if you don't"
  },
  {
    "startMs": 140560,
    "text": "track all of these payloads if you don't want to lose them. The second problem"
  },
  {
    "startMs": 142869,
    "text": "want to lose them. The second problem"
  },
  {
    "startMs": 142879,
    "text": "want to lose them. The second problem that we've noticed is that LM analyzers"
  },
  {
    "startMs": 145430,
    "text": "that we've noticed is that LM analyzers"
  },
  {
    "startMs": 145440,
    "text": "that we've noticed is that LM analyzers can be tricked. Um there was a really"
  },
  {
    "startMs": 147510,
    "text": "[Editorial paraphrase] Trail of"
  },
  {
    "startMs": 147520,
    "text": "Bits showed that"
  },
  {
    "startMs": 149830,
    "text": "an automated reviewer"
  },
  {
    "startMs": 149840,
    "text": "could accept a"
  },
  {
    "startMs": 152710,
    "text": "misleading explanation"
  },
  {
    "startMs": 152720,
    "text": "for a change"
  },
  {
    "startMs": 155190,
    "text": "to a project's"
  },
  {
    "startMs": 155200,
    "text": "package source. The"
  },
  {
    "startMs": 157270,
    "text": "explanation was part"
  },
  {
    "startMs": 157280,
    "text": "of the"
  },
  {
    "startMs": 159910,
    "text": "material under review."
  },
  {
    "startMs": 159920,
    "text": "It was not"
  },
  {
    "startMs": 162949,
    "text": "independent evidence of"
  },
  {
    "startMs": 162959,
    "text": "approval. A favorable"
  },
  {
    "startMs": 165190,
    "text": "judgment from"
  },
  {
    "startMs": 165200,
    "text": "a model was"
  },
  {
    "startMs": 169110,
    "text": "therefore insufficient to"
  },
  {
    "startMs": 169120,
    "text": "establish that the"
  },
  {
    "startMs": 171430,
    "text": "change was authorized."
  },
  {
    "startMs": 171440,
    "text": "bulletproof we've resorted to a different kind of action and we actually"
  },
  {
    "startMs": 173270,
    "text": "different kind of action and we actually"
  },
  {
    "startMs": 173280,
    "text": "different kind of action and we actually decided to just run the skill with the"
  },
  {
    "startMs": 175110,
    "text": "decided to just run the skill with the"
  },
  {
    "startMs": 175120,
    "text": "decided to just run the skill with the agent. Um this is a technique employed"
  },
  {
    "startMs": 177670,
    "text": "agent. Um this is a technique employed"
  },
  {
    "startMs": 177680,
    "text": "agent. Um this is a technique employed by malware researchers for years now. Uh"
  },
  {
    "startMs": 180550,
    "text": "by malware researchers for years now. Uh"
  },
  {
    "startMs": 180560,
    "text": "by malware researchers for years now. Uh and it's called detonation donation"
  },
  {
    "startMs": 183270,
    "text": "and it's called detonation donation"
  },
  {
    "startMs": 183280,
    "text": "and it's called detonation detonation chamber. So we created the same one but"
  },
  {
    "startMs": 186470,
    "text": "chamber. So we created the same one but"
  },
  {
    "startMs": 186480,
    "text": "chamber. So we created the same one but for agent for for agents and skills. And"
  },
  {
    "startMs": 189190,
    "text": "for agent for for agents and skills. And"
  },
  {
    "startMs": 189200,
    "text": "for agent for for agents and skills. And this was our first version. In our first"
  },
  {
    "startMs": 190949,
    "text": "this was our first version. In our first"
  },
  {
    "startMs": 190959,
    "text": "this was our first version. In our first version uh we created a task prompt. We"
  },
  {
    "startMs": 193830,
    "text": "version uh we created a task prompt. We"
  },
  {
    "startMs": 193840,
    "text": "version uh we created a task prompt. We put an agent and a skill inside a"
  },
  {
    "startMs": 195589,
    "text": "put an agent and a skill inside a"
  },
  {
    "startMs": 195599,
    "text": "put an agent and a skill inside a sandbox. We let it operate over like"
  },
  {
    "startMs": 198390,
    "text": "sandbox. We let it operate over like"
  },
  {
    "startMs": 198400,
    "text": "sandbox. We let it operate over like minutes or or hours until until it"
  },
  {
    "startMs": 200949,
    "text": "minutes or or hours until until it"
  },
  {
    "startMs": 200959,
    "text": "minutes or or hours until until it completed a task. with unobserved agent"
  },
  {
    "startMs": 203430,
    "text": "completed a task. with unobserved agent"
  },
  {
    "startMs": 203440,
    "text": "completed a task. with unobserved agent traces and analyzed it. You can imagine"
  },
  {
    "startMs": 206550,
    "text": "traces and analyzed it. You can imagine"
  },
  {
    "startMs": 206560,
    "text": "traces and analyzed it. You can imagine that it wasn't enough. Our first problem"
  },
  {
    "startMs": 208550,
    "text": "that it wasn't enough. Our first problem"
  },
  {
    "startMs": 208560,
    "text": "that it wasn't enough. Our first problem was that the environment was missing"
  },
  {
    "startMs": 211270,
    "text": "was that the environment was missing"
  },
  {
    "startMs": 211280,
    "text": "was that the environment was missing most of the time. A lot of skills rely"
  },
  {
    "startMs": 213750,
    "text": "most of the time. A lot of skills rely"
  },
  {
    "startMs": 213760,
    "text": "most of the time. A lot of skills rely on CLIs. They rely on specific services"
  },
  {
    "startMs": 217110,
    "text": "on CLIs. They rely on specific services"
  },
  {
    "startMs": 217120,
    "text": "on CLIs. They rely on specific services and even on on existence of the pro of"
  },
  {
    "startMs": 219990,
    "text": "and even on on existence of the pro of"
  },
  {
    "startMs": 220000,
    "text": "and even on on existence of the pro of projects. You can imagine notion skill"
  },
  {
    "startMs": 222949,
    "text": "projects. You can imagine notion skill"
  },
  {
    "startMs": 222959,
    "text": "projects. You can imagine notion skill for instance. This will have to have a"
  },
  {
    "startMs": 225589,
    "text": "for instance. This will have to have a"
  },
  {
    "startMs": 225599,
    "text": "for instance. This will have to have a notion service available to talk to. So"
  },
  {
    "startMs": 228149,
    "text": "notion service available to talk to. So"
  },
  {
    "startMs": 228159,
    "text": "notion service available to talk to. So we've added a world builder that looks"
  },
  {
    "startMs": 229990,
    "text": "we've added a world builder that looks"
  },
  {
    "startMs": 230000,
    "text": "we've added a world builder that looks at a skill and builds the appropriate uh"
  },
  {
    "startMs": 232949,
    "text": "at a skill and builds the appropriate uh"
  },
  {
    "startMs": 232959,
    "text": "at a skill and builds the appropriate uh environment accordingly."
  },
  {
    "startMs": 235350,
    "text": "environment accordingly."
  },
  {
    "startMs": 235360,
    "text": "environment accordingly. But then we'll cover another issue. A"
  },
  {
    "startMs": 237270,
    "text": "But then we'll cover another issue. A"
  },
  {
    "startMs": 237280,
    "text": "But then we'll cover another issue. A generic task prompt might not be enough"
  },
  {
    "startMs": 240789,
    "text": "generic task prompt might not be enough"
  },
  {
    "startMs": 240799,
    "text": "generic task prompt might not be enough for all skills. I mean think about it."
  },
  {
    "startMs": 243750,
    "text": "for all skills. I mean think about it."
  },
  {
    "startMs": 243760,
    "text": "for all skills. I mean think about it. You can have a presentation skill uh"
  },
  {
    "startMs": 246229,
    "text": "You can have a presentation skill uh"
  },
  {
    "startMs": 246239,
    "text": "You can have a presentation skill uh that needs to create a deck or"
  },
  {
    "startMs": 247509,
    "text": "that needs to create a deck or"
  },
  {
    "startMs": 247519,
    "text": "that needs to create a deck or deployment skill that need to ship a"
  },
  {
    "startMs": 248869,
    "text": "deployment skill that need to ship a"
  },
  {
    "startMs": 248879,
    "text": "deployment skill that need to ship a service a brainstorming skill that needs"
  },
  {
    "startMs": 251670,
    "text": "service a brainstorming skill that needs"
  },
  {
    "startMs": 251680,
    "text": "service a brainstorming skill that needs to explore an idea. Each and every one"
  },
  {
    "startMs": 253429,
    "text": "to explore an idea. Each and every one"
  },
  {
    "startMs": 253439,
    "text": "to explore an idea. Each and every one of them has an entirely different modus"
  },
  {
    "startMs": 255670,
    "text": "of them has an entirely different modus"
  },
  {
    "startMs": 255680,
    "text": "of them has an entirely different modus operandi. Let's take shipping shipping a"
  },
  {
    "startMs": 258310,
    "text": "operandi. Let's take shipping shipping a"
  },
  {
    "startMs": 258320,
    "text": "operandi. Let's take shipping shipping a service for instance. You need to learn"
  },
  {
    "startMs": 259830,
    "text": "service for instance. You need to learn"
  },
  {
    "startMs": 259840,
    "text": "service for instance. You need to learn how to configure it. You need to learn"
  },
  {
    "startMs": 261590,
    "text": "how to configure it. You need to learn"
  },
  {
    "startMs": 261600,
    "text": "how to configure it. You need to learn to deploy it. You need to tell it to"
  },
  {
    "startMs": 263749,
    "text": "to deploy it. You need to tell it to"
  },
  {
    "startMs": 263759,
    "text": "to deploy it. You need to tell it to recover from snapshots using snapshots."
  },
  {
    "startMs": 266629,
    "text": "recover from snapshots using snapshots."
  },
  {
    "startMs": 266639,
    "text": "recover from snapshots using snapshots. Um each and every one of them uh"
  },
  {
    "startMs": 269749,
    "text": "Um each and every one of them uh"
  },
  {
    "startMs": 269759,
    "text": "Um each and every one of them uh requires different set of prompts and"
  },
  {
    "startMs": 271830,
    "text": "requires different set of prompts and"
  },
  {
    "startMs": 271840,
    "text": "requires different set of prompts and you also need to need to make sure that"
  },
  {
    "startMs": 273590,
    "text": "you also need to need to make sure that"
  },
  {
    "startMs": 273600,
    "text": "you also need to need to make sure that you um cover every route in the in that"
  },
  {
    "startMs": 279030,
    "text": "you um cover every route in the in that"
  },
  {
    "startMs": 279040,
    "text": "you um cover every route in the in that skill because one of them can be"
  },
  {
    "startMs": 280310,
    "text": "skill because one of them can be"
  },
  {
    "startMs": 280320,
    "text": "skill because one of them can be malicious. So we created the operator"
  },
  {
    "startMs": 282310,
    "text": "malicious. So we created the operator"
  },
  {
    "startMs": 282320,
    "text": "malicious. So we created the operator that does just that. It reads through"
  },
  {
    "startMs": 283990,
    "text": "that does just that. It reads through"
  },
  {
    "startMs": 284000,
    "text": "that does just that. It reads through the skill and tries to analyze what are"
  },
  {
    "startMs": 286230,
    "text": "the skill and tries to analyze what are"
  },
  {
    "startMs": 286240,
    "text": "the skill and tries to analyze what are the different trajectories um that we"
  },
  {
    "startMs": 289749,
    "text": "the different trajectories um that we"
  },
  {
    "startMs": 289759,
    "text": "the different trajectories um that we should invoke. And while it worked"
  },
  {
    "startMs": 292390,
    "text": "should invoke. And while it worked"
  },
  {
    "startMs": 292400,
    "text": "should invoke. And while it worked pretty well, if you worked with agent,"
  },
  {
    "startMs": 294950,
    "text": "pretty well, if you worked with agent,"
  },
  {
    "startMs": 294960,
    "text": "pretty well, if you worked with agent, you can especially in the security"
  },
  {
    "startMs": 296550,
    "text": "[Editorial paraphrase] Our tests"
  },
  {
    "startMs": 296560,
    "text": "also ran"
  },
  {
    "startMs": 299749,
    "text": "into agent safeguards."
  },
  {
    "startMs": 299759,
    "text": "Some agents"
  },
  {
    "startMs": 302790,
    "text": "refused to"
  },
  {
    "startMs": 302800,
    "text": "continue when the"
  },
  {
    "startMs": 304950,
    "text": "requested behavior"
  },
  {
    "startMs": 304960,
    "text": "looked risky."
  },
  {
    "startMs": 308469,
    "text": "A refusal affects"
  },
  {
    "startMs": 308479,
    "text": "how much"
  },
  {
    "startMs": 310310,
    "text": "of the"
  },
  {
    "startMs": 310320,
    "text": "skill we can"
  },
  {
    "startMs": 312950,
    "text": "observe in"
  },
  {
    "startMs": 312960,
    "text": "one run."
  },
  {
    "startMs": 315350,
    "text": "The team explored"
  },
  {
    "startMs": 315360,
    "text": "that limitation"
  },
  {
    "startMs": 318710,
    "text": "inside its isolated"
  },
  {
    "startMs": 318720,
    "text": "research environment."
  },
  {
    "startMs": 320870,
    "text": "We needed"
  },
  {
    "startMs": 320880,
    "text": "to distinguish a"
  },
  {
    "startMs": 322550,
    "text": "test that"
  },
  {
    "startMs": 322560,
    "text": "stopped early"
  },
  {
    "startMs": 325590,
    "text": "from a test"
  },
  {
    "startMs": 325600,
    "text": "that showed"
  },
  {
    "startMs": 328390,
    "text": "the skill"
  },
  {
    "startMs": 328400,
    "text": "completed safely. The"
  },
  {
    "startMs": 333749,
    "text": "results depend"
  },
  {
    "startMs": 333759,
    "text": "on the"
  },
  {
    "startMs": 336710,
    "text": "setting, the task"
  },
  {
    "startMs": 336720,
    "text": "and the"
  },
  {
    "startMs": 338550,
    "text": "particular decisions"
  },
  {
    "startMs": 338560,
    "text": "the agent made."
  },
  {
    "startMs": 340230,
    "text": "There were"
  },
  {
    "startMs": 340240,
    "text": "false alarms too."
  },
  {
    "startMs": 342629,
    "text": "A legitimate"
  },
  {
    "startMs": 342639,
    "text": "skill may"
  },
  {
    "startMs": 344710,
    "text": "involve an operation"
  },
  {
    "startMs": 344720,
    "text": "that a"
  },
  {
    "startMs": 346550,
    "text": "model judges"
  },
  {
    "startMs": 346560,
    "text": "risky. The control"
  },
  {
    "startMs": 348790,
    "text": "can act"
  },
  {
    "startMs": 348800,
    "text": "as intended"
  },
  {
    "startMs": 350710,
    "text": "and still limit"
  },
  {
    "startMs": 350720,
    "text": "what the"
  },
  {
    "startMs": 353430,
    "text": "researchers can"
  },
  {
    "startMs": 353440,
    "text": "conclude about that"
  },
  {
    "startMs": 355029,
    "text": "run. We"
  },
  {
    "startMs": 355039,
    "text": "recorded the"
  },
  {
    "startMs": 356870,
    "text": "observed behavior and"
  },
  {
    "startMs": 356880,
    "text": "the limits"
  },
  {
    "startMs": 359270,
    "text": "of the evidence."
  },
  {
    "startMs": 359280,
    "text": "would still be triggered. So up until now we were dealing with the"
  },
  {
    "startMs": 361590,
    "text": "So up until now we were dealing with the"
  },
  {
    "startMs": 361600,
    "text": "So up until now we were dealing with the sandbox."
  },
  {
    "startMs": 363670,
    "text": "sandbox."
  },
  {
    "startMs": 363680,
    "text": "sandbox. At this point, we we we started to"
  },
  {
    "startMs": 365749,
    "text": "At this point, we we we started to"
  },
  {
    "startMs": 365759,
    "text": "At this point, we we we started to tackle the the the the capturing"
  },
  {
    "startMs": 368070,
    "text": "tackle the the the the capturing"
  },
  {
    "startMs": 368080,
    "text": "tackle the the the the capturing mechanism. So, agent traces can go that"
  },
  {
    "startMs": 373749,
    "text": "mechanism. So, agent traces can go that"
  },
  {
    "startMs": 373759,
    "text": "mechanism. So, agent traces can go that far. At some point, you'll be missing"
  },
  {
    "startMs": 376390,
    "text": "[Editorial paraphrase] A package"
  },
  {
    "startMs": 376400,
    "text": "installation can have"
  },
  {
    "startMs": 378790,
    "text": "side effects"
  },
  {
    "startMs": 378800,
    "text": "beyond the tool"
  },
  {
    "startMs": 381590,
    "text": "call shown"
  },
  {
    "startMs": 381600,
    "text": "in the agent's"
  },
  {
    "startMs": 384230,
    "text": "conversation. Work done"
  },
  {
    "startMs": 384240,
    "text": "by another"
  },
  {
    "startMs": 386230,
    "text": "process may touch"
  },
  {
    "startMs": 386240,
    "text": "files or"
  },
  {
    "startMs": 388390,
    "text": "communicate with a"
  },
  {
    "startMs": 388400,
    "text": "service. A"
  },
  {
    "startMs": 389990,
    "text": "reviewer following only"
  },
  {
    "startMs": 390000,
    "text": "the model's messages"
  },
  {
    "startMs": 392710,
    "text": "could miss"
  },
  {
    "startMs": 392720,
    "text": "those effects. We"
  },
  {
    "startMs": 393830,
    "text": "wanted the"
  },
  {
    "startMs": 393840,
    "text": "system to capture"
  },
  {
    "startMs": 396469,
    "text": "what the"
  },
  {
    "startMs": 396479,
    "text": "machine actually did"
  },
  {
    "startMs": 398230,
    "text": "during the installation."
  },
  {
    "startMs": 398240,
    "text": "also events and signals that we need to"
  },
  {
    "startMs": 399990,
    "text": "events and signals that we need to"
  },
  {
    "startMs": 400000,
    "text": "events and signals that we need to capture and we did just that as part of"
  },
  {
    "startMs": 402790,
    "text": "capture and we did just that as part of"
  },
  {
    "startMs": 402800,
    "text": "capture and we did just that as part of the capturing mechanism. We added"
  },
  {
    "startMs": 404469,
    "text": "the capturing mechanism. We added"
  },
  {
    "startMs": 404479,
    "text": "the capturing mechanism. We added process creation event file system event"
  },
  {
    "startMs": 407189,
    "text": "process creation event file system event"
  },
  {
    "startMs": 407199,
    "text": "process creation event file system event and network a network packet capturing"
  },
  {
    "startMs": 410230,
    "text": "and network a network packet capturing"
  },
  {
    "startMs": 410240,
    "text": "and network a network packet capturing given all of that along with the agent"
  },
  {
    "startMs": 411830,
    "text": "given all of that along with the agent"
  },
  {
    "startMs": 411840,
    "text": "given all of that along with the agent traces. We then moved it uh to a quality"
  },
  {
    "startMs": 414870,
    "text": "traces. We then moved it uh to a quality"
  },
  {
    "startMs": 414880,
    "text": "traces. We then moved it uh to a quality evidence and capture the behavior"
  },
  {
    "startMs": 420150,
    "text": "evidence and capture the behavior"
  },
  {
    "startMs": 420160,
    "text": "evidence and capture the behavior even this final form of the detonation"
  },
  {
    "startMs": 423189,
    "text": "even this final form of the detonation"
  },
  {
    "startMs": 423199,
    "text": "even this final form of the detonation chamber. Let's take a look at"
  },
  {
    "startMs": 427270,
    "text": "chamber. Let's take a look at"
  },
  {
    "startMs": 427280,
    "text": "chamber. Let's take a look at at an example skill. So Zach Corman, you"
  },
  {
    "startMs": 429830,
    "text": "at an example skill. So Zach Corman, you"
  },
  {
    "startMs": 429840,
    "text": "at an example skill. So Zach Corman, you should follow him on Twitter. He created"
  },
  {
    "startMs": 431430,
    "text": "should follow him on Twitter. He created"
  },
  {
    "startMs": 431440,
    "text": "[Editorial paraphrase] In Zach"
  },
  {
    "startMs": 433830,
    "text": "Corman's proof of"
  },
  {
    "startMs": 433840,
    "text": "concept, the"
  },
  {
    "startMs": 437350,
    "text": "first skill introduced"
  },
  {
    "startMs": 437360,
    "text": "another component"
  },
  {
    "startMs": 439430,
    "text": "whose behavior was"
  },
  {
    "startMs": 439440,
    "text": "absent from"
  },
  {
    "startMs": 441990,
    "text": "the file the"
  },
  {
    "startMs": 442000,
    "text": "user originally"
  },
  {
    "startMs": 444230,
    "text": "inspected. The additional"
  },
  {
    "startMs": 444240,
    "text": "material influenced"
  },
  {
    "startMs": 446230,
    "text": "what the agent"
  },
  {
    "startMs": 446240,
    "text": "did. The"
  },
  {
    "startMs": 447589,
    "text": "researchers used an"
  },
  {
    "startMs": 447599,
    "text": "innocuous demonstration"
  },
  {
    "startMs": 449990,
    "text": "to make that"
  },
  {
    "startMs": 450000,
    "text": "gap observable."
  },
  {
    "startMs": 452390,
    "text": "It showed why"
  },
  {
    "startMs": 452400,
    "text": "reviewing a"
  },
  {
    "startMs": 454550,
    "text": "well-named component in"
  },
  {
    "startMs": 454560,
    "text": "isolation could"
  },
  {
    "startMs": 457350,
    "text": "give a misleading"
  },
  {
    "startMs": 457360,
    "text": "impression of"
  },
  {
    "startMs": 459430,
    "text": "the complete task."
  },
  {
    "startMs": 459440,
    "text": "Inspecting what"
  },
  {
    "startMs": 461029,
    "text": "was present at"
  },
  {
    "startMs": 461039,
    "text": "installation time"
  },
  {
    "startMs": 464870,
    "text": "left part of"
  },
  {
    "startMs": 464880,
    "text": "the behavior"
  },
  {
    "startMs": 468070,
    "text": "unexplained. The chamber's"
  },
  {
    "startMs": 468080,
    "text": "evidence connected"
  },
  {
    "startMs": 471430,
    "text": "the later action"
  },
  {
    "startMs": 471440,
    "text": "with the"
  },
  {
    "startMs": 473350,
    "text": "earlier component that"
  },
  {
    "startMs": 473360,
    "text": "caused it."
  },
  {
    "startMs": 475510,
    "text": "That attribution came"
  },
  {
    "startMs": 475520,
    "text": "from a"
  },
  {
    "startMs": 477670,
    "text": "particular observed run."
  },
  {
    "startMs": 477680,
    "text": "chamber. Using this approach, we were able to"
  },
  {
    "startMs": 480629,
    "text": "Using this approach, we were able to"
  },
  {
    "startMs": 480639,
    "text": "Using this approach, we were able to uncover 100 malicious skill out of"
  },
  {
    "startMs": 483510,
    "text": "uncover 100 malicious skill out of"
  },
  {
    "startMs": 483520,
    "text": "uncover 100 malicious skill out of thousands and they were shut off uh the"
  },
  {
    "startMs": 487110,
    "text": "thousands and they were shut off uh the"
  },
  {
    "startMs": 487120,
    "text": "thousands and they were shut off uh the skills.sh framework."
  },
  {
    "startMs": 490790,
    "text": "skills.sh framework."
  },
  {
    "startMs": 490800,
    "text": "skills.sh framework. Now let's take a look at another"
  },
  {
    "startMs": 492070,
    "text": "Now let's take a look at another"
  },
  {
    "startMs": 492080,
    "text": "Now let's take a look at another example. Poly market. Uh this is this"
  },
  {
    "startMs": 495749,
    "text": "[Editorial paraphrase] Another skill"
  },
  {
    "startMs": 495759,
    "text": "claimed to"
  },
  {
    "startMs": 497749,
    "text": "use a Polymarket"
  },
  {
    "startMs": 497759,
    "text": "dependency. The"
  },
  {
    "startMs": 499749,
    "text": "researchers found"
  },
  {
    "startMs": 499759,
    "text": "that its package"
  },
  {
    "startMs": 502790,
    "text": "identity differed"
  },
  {
    "startMs": 502800,
    "text": "from the expected"
  },
  {
    "startMs": 504469,
    "text": "one and"
  },
  {
    "startMs": 504479,
    "text": "that its"
  },
  {
    "startMs": 508790,
    "text": "origin was unofficial."
  },
  {
    "startMs": 508800,
    "text": "They compared"
  },
  {
    "startMs": 511670,
    "text": "what had actually"
  },
  {
    "startMs": 511680,
    "text": "been installed"
  },
  {
    "startMs": 514709,
    "text": "with what"
  },
  {
    "startMs": 514719,
    "text": "a user would"
  },
  {
    "startMs": 517190,
    "text": "reasonably have"
  },
  {
    "startMs": 517200,
    "text": "expected. Further inspection"
  },
  {
    "startMs": 518949,
    "text": "showed that"
  },
  {
    "startMs": 518959,
    "text": "the substituted"
  },
  {
    "startMs": 521990,
    "text": "software collected sensitive"
  },
  {
    "startMs": 522000,
    "text": "information. Similar"
  },
  {
    "startMs": 524710,
    "text": "names can hide"
  },
  {
    "startMs": 524720,
    "text": "a material"
  },
  {
    "startMs": 527430,
    "text": "difference in"
  },
  {
    "startMs": 527440,
    "text": "who supplied a"
  },
  {
    "startMs": 529030,
    "text": "dependency and"
  },
  {
    "startMs": 529040,
    "text": "what it does."
  },
  {
    "startMs": 531430,
    "text": "[Editorial paraphrase] The team"
  },
  {
    "startMs": 531440,
    "text": "also saw cases"
  },
  {
    "startMs": 536470,
    "text": "in which"
  },
  {
    "startMs": 536480,
    "text": "a skill could"
  },
  {
    "startMs": 538790,
    "text": "return after"
  },
  {
    "startMs": 538800,
    "text": "someone removed it."
  },
  {
    "startMs": 541190,
    "text": "Deleting the visible"
  },
  {
    "startMs": 541200,
    "text": "component did"
  },
  {
    "startMs": 544389,
    "text": "not always undo"
  },
  {
    "startMs": 544399,
    "text": "the changes"
  },
  {
    "startMs": 549030,
    "text": "the installation had"
  },
  {
    "startMs": 549040,
    "text": "made to the"
  },
  {
    "startMs": 550470,
    "text": "environment. That"
  },
  {
    "startMs": 550480,
    "text": "matters to someone"
  },
  {
    "startMs": 552550,
    "text": "investigating a"
  },
  {
    "startMs": 552560,
    "text": "machine that appears"
  },
  {
    "startMs": 555350,
    "text": "clean after"
  },
  {
    "startMs": 555360,
    "text": "an uninstall. Another"
  },
  {
    "startMs": 557269,
    "text": "example involved a"
  },
  {
    "startMs": 557279,
    "text": "third-party version"
  },
  {
    "startMs": 560070,
    "text": "of a skill"
  },
  {
    "startMs": 560080,
    "text": "creator silently"
  },
  {
    "startMs": 562310,
    "text": "replacing the official"
  },
  {
    "startMs": 562320,
    "text": "version. Users could"
  },
  {
    "startMs": 564949,
    "text": "believe they"
  },
  {
    "startMs": 564959,
    "text": "were still invoking"
  },
  {
    "startMs": 567350,
    "text": "a familiar"
  },
  {
    "startMs": 567360,
    "text": "capability while a"
  },
  {
    "startMs": 570070,
    "text": "different implementation"
  },
  {
    "startMs": 570080,
    "text": "answered. Those are"
  },
  {
    "startMs": 573190,
    "text": "observable changes to"
  },
  {
    "startMs": 573200,
    "text": "the installed"
  },
  {
    "startMs": 575990,
    "text": "environment, including changes"
  },
  {
    "startMs": 576000,
    "text": "a person"
  },
  {
    "startMs": 577829,
    "text": "might never see"
  },
  {
    "startMs": 577839,
    "text": "during the interaction."
  },
  {
    "startMs": 580150,
    "text": "trick that we've seen a lot of actors"
  },
  {
    "startMs": 580160,
    "text": "[Editorial paraphrase] A skill"
  },
  {
    "startMs": 582070,
    "text": "can depend"
  },
  {
    "startMs": 582080,
    "text": "on instructions"
  },
  {
    "startMs": 583910,
    "text": "stored outside"
  },
  {
    "startMs": 583920,
    "text": "the installed"
  },
  {
    "startMs": 586310,
    "text": "package. Some"
  },
  {
    "startMs": 586320,
    "text": "legitimate skills"
  },
  {
    "startMs": 588630,
    "text": "do this"
  },
  {
    "startMs": 588640,
    "text": "too. The"
  },
  {
    "startMs": 590790,
    "text": "important point"
  },
  {
    "startMs": 590800,
    "text": "for review"
  },
  {
    "startMs": 593190,
    "text": "is that"
  },
  {
    "startMs": 593200,
    "text": "the material"
  },
  {
    "startMs": 597030,
    "text": "available today"
  },
  {
    "startMs": 597040,
    "text": "can change"
  },
  {
    "startMs": 598870,
    "text": "later, without"
  },
  {
    "startMs": 598880,
    "text": "a change to"
  },
  {
    "startMs": 600949,
    "text": "the local"
  },
  {
    "startMs": 600959,
    "text": "file. The"
  },
  {
    "startMs": 602389,
    "text": "original publisher"
  },
  {
    "startMs": 602399,
    "text": "may update"
  },
  {
    "startMs": 604870,
    "text": "it and"
  },
  {
    "startMs": 604880,
    "text": "control of"
  },
  {
    "startMs": 607110,
    "text": "the external"
  },
  {
    "startMs": 607120,
    "text": "location itself"
  },
  {
    "startMs": 609430,
    "text": "can change."
  },
  {
    "startMs": 609440,
    "text": "A reviewer"
  },
  {
    "startMs": 611990,
    "text": "needs to"
  },
  {
    "startMs": 612000,
    "text": "distinguish what"
  },
  {
    "startMs": 613910,
    "text": "they actually"
  },
  {
    "startMs": 613920,
    "text": "inspected from"
  },
  {
    "startMs": 616470,
    "text": "what a"
  },
  {
    "startMs": 616480,
    "text": "later invocation received."
  },
  {
    "startMs": 618470,
    "text": "[Editorial paraphrase] Some skills"
  },
  {
    "startMs": 618480,
    "text": "could become active"
  },
  {
    "startMs": 620710,
    "text": "in response to"
  },
  {
    "startMs": 620720,
    "text": "ordinary user activity,"
  },
  {
    "startMs": 623670,
    "text": "even outside the"
  },
  {
    "startMs": 623680,
    "text": "task for"
  },
  {
    "startMs": 625430,
    "text": "which they were"
  },
  {
    "startMs": 625440,
    "text": "originally chosen. That"
  },
  {
    "startMs": 627350,
    "text": "changes how often"
  },
  {
    "startMs": 627360,
    "text": "a risky behavior"
  },
  {
    "startMs": 629430,
    "text": "can occur and"
  },
  {
    "startMs": 629440,
    "text": "how visible"
  },
  {
    "startMs": 631990,
    "text": "it is to"
  },
  {
    "startMs": 632000,
    "text": "the user. The"
  },
  {
    "startMs": 633670,
    "text": "team treated that"
  },
  {
    "startMs": 633680,
    "text": "as part of"
  },
  {
    "startMs": 635750,
    "text": "the security review."
  },
  {
    "startMs": 635760,
    "text": "be aware of that. But let's talk about a campaign that we"
  },
  {
    "startMs": 637430,
    "text": "But let's talk about a campaign that we"
  },
  {
    "startMs": 637440,
    "text": "But let's talk about a campaign that we that we've uncovered. Uh meet Carly or"
  },
  {
    "startMs": 639750,
    "text": "that we've uncovered. Uh meet Carly or"
  },
  {
    "startMs": 639760,
    "text": "that we've uncovered. Uh meet Carly or Carly paperclipipped as he known in"
  },
  {
    "startMs": 641509,
    "text": "Carly paperclipipped as he known in"
  },
  {
    "startMs": 641519,
    "text": "Carly paperclipipped as he known in GitHub. He faked the paperclip"
  },
  {
    "startMs": 644949,
    "text": "GitHub. He faked the paperclip"
  },
  {
    "startMs": 644959,
    "text": "GitHub. He faked the paperclip organization. And paperclipipped is a"
  },
  {
    "startMs": 647030,
    "text": "organization. And paperclipipped is a"
  },
  {
    "startMs": 647040,
    "text": "organization. And paperclipipped is a wellknown uh project is it's an open"
  },
  {
    "startMs": 650230,
    "text": "wellknown uh project is it's an open"
  },
  {
    "startMs": 650240,
    "text": "wellknown uh project is it's an open source uh project aimed for a a"
  },
  {
    "startMs": 653190,
    "text": "source uh project aimed for a a"
  },
  {
    "startMs": 653200,
    "text": "source uh project aimed for a a orchestration of of various agents. Um"
  },
  {
    "startMs": 656949,
    "text": "orchestration of of various agents. Um"
  },
  {
    "startMs": 656959,
    "text": "orchestration of of various agents. Um early here basically created a fake"
  },
  {
    "startMs": 658949,
    "text": "early here basically created a fake"
  },
  {
    "startMs": 658959,
    "text": "early here basically created a fake organization that mimics it. He bought a"
  },
  {
    "startMs": 661509,
    "text": "organization that mimics it. He bought a"
  },
  {
    "startMs": 661519,
    "text": "organization that mimics it. He bought a he he registered the domain under kind"
  },
  {
    "startMs": 663990,
    "text": "he he registered the domain under kind"
  },
  {
    "startMs": 664000,
    "text": "he he registered the domain under kind of the same name, created a lookalike"
  },
  {
    "startMs": 666150,
    "text": "of the same name, created a lookalike"
  },
  {
    "startMs": 666160,
    "text": "[Editorial paraphrase] Investigating the"
  },
  {
    "startMs": 668069,
    "text": "Paperclip lookalike,"
  },
  {
    "startMs": 668079,
    "text": "the team found"
  },
  {
    "startMs": 671350,
    "text": "behavior absent"
  },
  {
    "startMs": 671360,
    "text": "from the"
  },
  {
    "startMs": 673190,
    "text": "legitimate project. Something"
  },
  {
    "startMs": 673200,
    "text": "presented as"
  },
  {
    "startMs": 675910,
    "text": "ordinary application logging"
  },
  {
    "startMs": 675920,
    "text": "led to"
  },
  {
    "startMs": 678550,
    "text": "a service"
  },
  {
    "startMs": 678560,
    "text": "controlled by the"
  },
  {
    "startMs": 679990,
    "text": "attacker. Its"
  },
  {
    "startMs": 680000,
    "text": "relationship to"
  },
  {
    "startMs": 682389,
    "text": "the surrounding application"
  },
  {
    "startMs": 682399,
    "text": "made the"
  },
  {
    "startMs": 685190,
    "text": "change easy to"
  },
  {
    "startMs": 685200,
    "text": "overlook. The"
  },
  {
    "startMs": 690870,
    "text": "name of"
  },
  {
    "startMs": 690880,
    "text": "the feature did"
  },
  {
    "startMs": 693509,
    "text": "not establish"
  },
  {
    "startMs": 693519,
    "text": "what it did."
  },
  {
    "startMs": 695910,
    "text": "[Editorial paraphrase] The additional"
  },
  {
    "startMs": 695920,
    "text": "software obtained"
  },
  {
    "startMs": 699030,
    "text": "sensitive local"
  },
  {
    "startMs": 699040,
    "text": "authentication material and"
  },
  {
    "startMs": 702150,
    "text": "sent it"
  },
  {
    "startMs": 702160,
    "text": "to the"
  },
  {
    "startMs": 704949,
    "text": "attacker. The"
  },
  {
    "startMs": 704959,
    "text": "researchers observed that"
  },
  {
    "startMs": 708069,
    "text": "a component"
  },
  {
    "startMs": 708079,
    "text": "of the"
  },
  {
    "startMs": 711030,
    "text": "activity was"
  },
  {
    "startMs": 711040,
    "text": "short-lived. The important"
  },
  {
    "startMs": 713670,
    "text": "evidence was"
  },
  {
    "startMs": 713680,
    "text": "the connection"
  },
  {
    "startMs": 715269,
    "text": "between access to"
  },
  {
    "startMs": 715279,
    "text": "sensitive information"
  },
  {
    "startMs": 716949,
    "text": "and a"
  },
  {
    "startMs": 716959,
    "text": "destination controlled"
  },
  {
    "startMs": 719430,
    "text": "by someone other"
  },
  {
    "startMs": 719440,
    "text": "than the"
  },
  {
    "startMs": 724069,
    "text": "user. That"
  },
  {
    "startMs": 724079,
    "text": "gave the"
  },
  {
    "startMs": 725910,
    "text": "team a much"
  },
  {
    "startMs": 725920,
    "text": "stronger basis"
  },
  {
    "startMs": 727750,
    "text": "for identifying"
  },
  {
    "startMs": 727760,
    "text": "credential theft"
  },
  {
    "startMs": 729910,
    "text": "than a record"
  },
  {
    "startMs": 729920,
    "text": "of a"
  },
  {
    "startMs": 734069,
    "text": "sensitive file"
  },
  {
    "startMs": 734079,
    "text": "access in isolation."
  },
  {
    "startMs": 737590,
    "text": "did the same thing in browser. Um but"
  },
  {
    "startMs": 737600,
    "text": "did the same thing in browser. Um but this this was a Python package but he"
  },
  {
    "startMs": 739190,
    "text": "this this was a Python package but he"
  },
  {
    "startMs": 739200,
    "text": "this this was a Python package but he used the same command and control and"
  },
  {
    "startMs": 741269,
    "text": "used the same command and control and"
  },
  {
    "startMs": 741279,
    "text": "used the same command and control and then he tried to publish it in Pi. That"
  },
  {
    "startMs": 744150,
    "text": "then he tried to publish it in Pi. That"
  },
  {
    "startMs": 744160,
    "text": "then he tried to publish it in Pi. That didn't work. It like under two hours it"
  },
  {
    "startMs": 746470,
    "text": "didn't work. It like under two hours it"
  },
  {
    "startMs": 746480,
    "text": "didn't work. It like under two hours it was just dumb. He did the same thing"
  },
  {
    "startMs": 748230,
    "text": "was just dumb. He did the same thing"
  },
  {
    "startMs": 748240,
    "text": "was just dumb. He did the same thing with paperclip AI, which is the Python"
  },
  {
    "startMs": 750389,
    "text": "with paperclip AI, which is the Python"
  },
  {
    "startMs": 750399,
    "text": "with paperclip AI, which is the Python version of what we just saw. And that"
  },
  {
    "startMs": 752870,
    "text": "version of what we just saw. And that"
  },
  {
    "startMs": 752880,
    "text": "version of what we just saw. And that also went down after less than an hour."
  },
  {
    "startMs": 755190,
    "text": "also went down after less than an hour."
  },
  {
    "startMs": 755200,
    "text": "also went down after less than an hour. Well, at this point, you'd think that"
  },
  {
    "startMs": 756710,
    "text": "Well, at this point, you'd think that"
  },
  {
    "startMs": 756720,
    "text": "Well, at this point, you'd think that we'd be winning, but no, because the"
  },
  {
    "startMs": 760389,
    "text": "we'd be winning, but no, because the"
  },
  {
    "startMs": 760399,
    "text": "we'd be winning, but no, because the skins that were using the same command"
  },
  {
    "startMs": 762069,
    "text": "skins that were using the same command"
  },
  {
    "startMs": 762079,
    "text": "skins that were using the same command and control were actually trading"
  },
  {
    "startMs": 763990,
    "text": "and control were actually trading"
  },
  {
    "startMs": 764000,
    "text": "and control were actually trading trending at that time to the point where"
  },
  {
    "startMs": 766470,
    "text": "trending at that time to the point where"
  },
  {
    "startMs": 766480,
    "text": "trending at that time to the point where they had 1.7 million total downloads."
  },
  {
    "startMs": 770550,
    "text": "[Editorial paraphrase] Those skills"
  },
  {
    "startMs": 770560,
    "text": "had around 1.7"
  },
  {
    "startMs": 773990,
    "text": "million total downloads."
  },
  {
    "startMs": 774000,
    "text": "That measures distribution."
  },
  {
    "startMs": 776069,
    "text": "It does not"
  },
  {
    "startMs": 776079,
    "text": "establish how many"
  },
  {
    "startMs": 779430,
    "text": "devices executed the"
  },
  {
    "startMs": 779440,
    "text": "malicious behavior"
  },
  {
    "startMs": 781269,
    "text": "or how many"
  },
  {
    "startMs": 781279,
    "text": "credentials were stolen."
  },
  {
    "startMs": 783990,
    "text": "When the researchers"
  },
  {
    "startMs": 784000,
    "text": "examined the skills,"
  },
  {
    "startMs": 786310,
    "text": "they connected them"
  },
  {
    "startMs": 786320,
    "text": "to the same"
  },
  {
    "startMs": 788870,
    "text": "infrastructure and recognized"
  },
  {
    "startMs": 788880,
    "text": "the same"
  },
  {
    "startMs": 790870,
    "text": "credential-harvesting behavior as"
  },
  {
    "startMs": 790880,
    "text": "in the earlier"
  },
  {
    "startMs": 793110,
    "text": "investigation. Taking down"
  },
  {
    "startMs": 793120,
    "text": "a package in"
  },
  {
    "startMs": 795269,
    "text": "one ecosystem had"
  },
  {
    "startMs": 795279,
    "text": "left another distribution"
  },
  {
    "startMs": 798470,
    "text": "route in place."
  },
  {
    "startMs": 798480,
    "text": "same chain. We reported the incident to Versell and Microsoft and under lasted"
  },
  {
    "startMs": 800389,
    "text": "Versell and Microsoft and under lasted"
  },
  {
    "startMs": 800399,
    "text": "Versell and Microsoft and under lasted 12 hours they took everything down. If"
  },
  {
    "startMs": 803110,
    "text": "12 hours they took everything down. If"
  },
  {
    "startMs": 803120,
    "text": "12 hours they took everything down. If you want to read more about it, you"
  },
  {
    "startMs": 804550,
    "text": "you want to read more about it, you"
  },
  {
    "startMs": 804560,
    "text": "you want to read more about it, you should read the Zenity Labs blog. It's"
  },
  {
    "startMs": 807829,
    "text": "should read the Zenity Labs blog. It's"
  },
  {
    "startMs": 807839,
    "text": "should read the Zenity Labs blog. It's very interesting, incredible work."
  },
  {
    "startMs": 810889,
    "text": "very interesting, incredible work."
  },
  {
    "startMs": 810899,
    "text": "very interesting, incredible work. [snorts]"
  },
  {
    "startMs": 812150,
    "text": "[snorts]"
  },
  {
    "startMs": 812160,
    "text": "[snorts] Um,"
  },
  {
    "startMs": 813670,
    "text": "Um,"
  },
  {
    "startMs": 813680,
    "text": "Um, skill is just one single part of uh of"
  },
  {
    "startMs": 817269,
    "text": "skill is just one single part of uh of"
  },
  {
    "startMs": 817279,
    "text": "skill is just one single part of uh of the agent supply chain. Everything that"
  },
  {
    "startMs": 819350,
    "text": "the agent supply chain. Everything that"
  },
  {
    "startMs": 819360,
    "text": "the agent supply chain. Everything that goes inside the agent context is is part"
  },
  {
    "startMs": 821590,
    "text": "goes inside the agent context is is part"
  },
  {
    "startMs": 821600,
    "text": "goes inside the agent context is is part of it. It can be a website, it can be"
  },
  {
    "startMs": 824629,
    "text": "of it. It can be a website, it can be"
  },
  {
    "startMs": 824639,
    "text": "of it. It can be a website, it can be rows in your database, it can be"
  },
  {
    "startMs": 826069,
    "text": "rows in your database, it can be"
  },
  {
    "startMs": 826079,
    "text": "rows in your database, it can be packages, it can even be a YouTube"
  },
  {
    "startMs": 827750,
    "text": "packages, it can even be a YouTube"
  },
  {
    "startMs": 827760,
    "text": "packages, it can even be a YouTube comment. Everything that comes into the"
  },
  {
    "startMs": 829750,
    "text": "comment. Everything that comes into the"
  },
  {
    "startMs": 829760,
    "text": "comment. Everything that comes into the context is under risk."
  },
  {
    "startMs": 832389,
    "text": "context is under risk."
  },
  {
    "startMs": 832399,
    "text": "context is under risk. And if we talk about skills in"
  },
  {
    "startMs": 834150,
    "text": "And if we talk about skills in"
  },
  {
    "startMs": 834160,
    "text": "And if we talk about skills in particular,"
  },
  {
    "startMs": 835670,
    "text": "particular,"
  },
  {
    "startMs": 835680,
    "text": "particular, you need to treat them as uh as package"
  },
  {
    "startMs": 837590,
    "text": "you need to treat them as uh as package"
  },
  {
    "startMs": 837600,
    "text": "you need to treat them as uh as package dependencies. Um you need to inspect"
  },
  {
    "startMs": 839990,
    "text": "dependencies. Um you need to inspect"
  },
  {
    "startMs": 840000,
    "text": "dependencies. Um you need to inspect everything that it loads, limit what it"
  },
  {
    "startMs": 842150,
    "text": "everything that it loads, limit what it"
  },
  {
    "startMs": 842160,
    "text": "everything that it loads, limit what it can access, lease privileges as you're"
  },
  {
    "startMs": 844470,
    "text": "can access, lease privileges as you're"
  },
  {
    "startMs": 844480,
    "text": "can access, lease privileges as you're well aware, and observe what is actually"
  },
  {
    "startMs": 847110,
    "text": "well aware, and observe what is actually"
  },
  {
    "startMs": 847120,
    "text": "well aware, and observe what is actually being run."
  },
  {
    "startMs": 849269,
    "text": "being run."
  },
  {
    "startMs": 849279,
    "text": "being run. Now, this entire work on the detonation"
  },
  {
    "startMs": 851829,
    "text": "Now, this entire work on the detonation"
  },
  {
    "startMs": 851839,
    "text": "Now, this entire work on the detonation shaver was done by the entire research"
  },
  {
    "startMs": 855910,
    "text": "shaver was done by the entire research"
  },
  {
    "startMs": 855920,
    "text": "shaver was done by the entire research and engineering thing that you see over"
  },
  {
    "startMs": 857590,
    "text": "and engineering thing that you see over"
  },
  {
    "startMs": 857600,
    "text": "and engineering thing that you see over here. Highly talented people, and I"
  },
  {
    "startMs": 860069,
    "text": "here. Highly talented people, and I"
  },
  {
    "startMs": 860079,
    "text": "here. Highly talented people, and I encourage you to follow them."
  },
  {
    "startMs": 862470,
    "text": "encourage you to follow them."
  },
  {
    "startMs": 862480,
    "text": "encourage you to follow them. And with that, if you want to test out"
  },
  {
    "startMs": 864389,
    "text": "And with that, if you want to test out"
  },
  {
    "startMs": 864399,
    "text": "And with that, if you want to test out your skills, it's available in neoto.io."
  },
  {
    "startMs": 866870,
    "text": "your skills, it's available in neoto.io."
  },
  {
    "startMs": 866880,
    "text": "your skills, it's available in neoto.io. This is detonation chamber."
  }
]