[
  {
    "startMs": 12480,
    "text": "Thanks everyone for coming. So we'll be"
  },
  {
    "startMs": 14400,
    "text": "talking about how um to use Agentic sort"
  },
  {
    "startMs": 18000,
    "text": "of orchestration to command many many"
  },
  {
    "startMs": 20640,
    "text": "different drones to achieve the"
  },
  {
    "startMs": 21760,
    "text": "different tasks that we have ahead of"
  },
  {
    "startMs": 23519,
    "text": "us. and just going to rethink this"
  },
  {
    "startMs": 26160,
    "text": "presentation a bit and not just jump"
  },
  {
    "startMs": 27599,
    "text": "straight into slides, but instead we're"
  },
  {
    "startMs": 29840,
    "text": "going to fly. Um, so what we have here"
  },
  {
    "startMs": 33200,
    "text": "on the left hand side is a real time"
  },
  {
    "startMs": 35680,
    "text": "view. What we're going to be doing right"
  },
  {
    "startMs": 37120,
    "text": "now, am I showing anything?"
  },
  {
    "startMs": 41600,
    "text": ">> Well, I'm flying. There you go. Sweet."
  },
  {
    "startMs": 44719,
    "text": "Okay. Um, we are somewhere here in the"
  },
  {
    "startMs": 47600,
    "text": "city down south, which where where our"
  },
  {
    "startMs": 49840,
    "text": "headquarters is. Uh we have a few drones"
  },
  {
    "startMs": 52640,
    "text": "up and I'm going to hit launch. Uh and"
  },
  {
    "startMs": 56320,
    "text": "these are drones that are in docked"
  },
  {
    "startMs": 58719,
    "text": "stations. So we calling this drones as"
  },
  {
    "startMs": 60320,
    "text": "infrastructure uh where we actually have"
  },
  {
    "startMs": 62719,
    "text": "thousands of these drones now planted"
  },
  {
    "startMs": 64640,
    "text": "around the country with power utilities"
  },
  {
    "startMs": 67280,
    "text": "with uh public safety uh with"
  },
  {
    "startMs": 69840,
    "text": "construction companies. And what I'm"
  },
  {
    "startMs": 72159,
    "text": "doing right now is using my keyboard to"
  },
  {
    "startMs": 74640,
    "text": "simply fly here. Uh for those of you"
  },
  {
    "startMs": 77280,
    "text": "that know the area, this is San Mateo."
  },
  {
    "startMs": 79439,
    "text": "And perhaps if I kind of zoom in here,"
  },
  {
    "startMs": 82000,
    "text": "we may see a very faint render of the uh"
  },
  {
    "startMs": 84799,
    "text": "SF skyline. Although the uh the fog city"
  },
  {
    "startMs": 88159,
    "text": "is always there. So we might just say"
  },
  {
    "startMs": 89600,
    "text": "hello to um the uh SFO airport here."
  },
  {
    "startMs": 93759,
    "text": "Some planes are launching. If anyone has"
  },
  {
    "startMs": 95600,
    "text": "a plane tracker app, they can sort of"
  },
  {
    "startMs": 96960,
    "text": "see this is uh realtime stuff there. So"
  },
  {
    "startMs": 100720,
    "text": "what we have been building is the full"
  },
  {
    "startMs": 102400,
    "text": "autonomy stack behind like how does a"
  },
  {
    "startMs": 104320,
    "text": "vehicle operate autonomously? How does"
  },
  {
    "startMs": 105840,
    "text": "the cloud system operate here? How do"
  },
  {
    "startMs": 107520,
    "text": "the cloud servers work? uh and where"
  },
  {
    "startMs": 109680,
    "text": "does the uh different levels of"
  },
  {
    "startMs": 111520,
    "text": "intelligence and automation needs to"
  },
  {
    "startMs": 113200,
    "text": "happen for us to make this happen"
  },
  {
    "startMs": 114960,
    "text": "robustly such that when I'm here and"
  },
  {
    "startMs": 117360,
    "text": "saying hey oh there's an incident"
  },
  {
    "startMs": 118799,
    "text": "happening here I need to go respond I"
  },
  {
    "startMs": 121119,
    "text": "could at the same time go back here and"
  },
  {
    "startMs": 123360,
    "text": "say hey what about that other thing"
  },
  {
    "startMs": 124960,
    "text": "that's happening on the other side of"
  },
  {
    "startMs": 126159,
    "text": "the country what if we launch that"
  },
  {
    "startMs": 128160,
    "text": "instead so while that's happening I'm"
  },
  {
    "startMs": 131039,
    "text": "now going to launch something in"
  },
  {
    "startMs": 133120,
    "text": "Colorado"
  },
  {
    "startMs": 134720,
    "text": "so this is a imagine some sort of fire"
  },
  {
    "startMs": 137680,
    "text": "incident has happen on your on the power"
  },
  {
    "startMs": 139520,
    "text": "lines and we wanted to go out and"
  },
  {
    "startMs": 141680,
    "text": "inspect those things. So, a dock is now"
  },
  {
    "startMs": 144160,
    "text": "opening up in Colorado while the first"
  },
  {
    "startMs": 146080,
    "text": "drone is still flying safely. Um, and"
  },
  {
    "startMs": 149200,
    "text": "I'm just going to uh let it do all the"
  },
  {
    "startMs": 150879,
    "text": "safety checks that it needs to do before"
  },
  {
    "startMs": 152640,
    "text": "the launch. And this is all happening in"
  },
  {
    "startMs": 154640,
    "text": "sort of conference Wi-Fi traffic. So,"
  },
  {
    "startMs": 156560,
    "text": "you can imagine I can shut down my"
  },
  {
    "startMs": 158080,
    "text": "laptop right now and everything needs to"
  },
  {
    "startMs": 159680,
    "text": "safely happen behind the scenes."
  },
  {
    "startMs": 162480,
    "text": "Um, so I'm going to do this while the"
  },
  {
    "startMs": 165040,
    "text": "first part is still happening."
  },
  {
    "startMs": 167599,
    "text": "Let me let's go back to the first drone."
  },
  {
    "startMs": 172800,
    "text": "Might give it another set of"
  },
  {
    "startMs": 173840,
    "text": "instruction. Let's have a look around"
  },
  {
    "startMs": 175440,
    "text": "here on the first drone. The second"
  },
  {
    "startMs": 177120,
    "text": "drone has sort of kick started off and"
  },
  {
    "startMs": 179519,
    "text": "maybe there's some cars sort of going"
  },
  {
    "startMs": 181040,
    "text": "around there um that we can perhaps"
  },
  {
    "startMs": 183760,
    "text": "track. So, let's track and what's this"
  },
  {
    "startMs": 188159,
    "text": "car doing here? All right. So, we're now"
  },
  {
    "startMs": 190159,
    "text": "tracking this car. Maybe this is a"
  },
  {
    "startMs": 191519,
    "text": "runaway car that we needed to follow."
  },
  {
    "startMs": 193519,
    "text": "And I'm hands off right now. This is uh"
  },
  {
    "startMs": 195760,
    "text": "the autonomous system kind of taking"
  },
  {
    "startMs": 197360,
    "text": "over um through the various interactions"
  },
  {
    "startMs": 199599,
    "text": "that I've given uh for it to do. And at"
  },
  {
    "startMs": 202800,
    "text": "the same time while this is happening we"
  },
  {
    "startMs": 204959,
    "text": "can do the final thing which is yet"
  },
  {
    "startMs": 207440,
    "text": "another sort of drone in the system uh"
  },
  {
    "startMs": 211120,
    "text": "back at our HQ"
  },
  {
    "startMs": 214560,
    "text": "and we can say hey let's why don't we"
  },
  {
    "startMs": 216400,
    "text": "run a third drone."
  },
  {
    "startMs": 218400,
    "text": "So what we're building towards is how do"
  },
  {
    "startMs": 220720,
    "text": "we enable autonomy at scale where"
  },
  {
    "startMs": 224159,
    "text": "traditionally how it started off"
  },
  {
    "startMs": 226080,
    "text": "historically 15 years ago that you might"
  },
  {
    "startMs": 228560,
    "text": "have a drone at home. It's a hobbyist"
  },
  {
    "startMs": 231040,
    "text": "drone and you might play around with it."
  },
  {
    "startMs": 232560,
    "text": "You will tinker with it. You will work"
  },
  {
    "startMs": 233920,
    "text": "with the controlling software. And then"
  },
  {
    "startMs": 236080,
    "text": "about 10 years ago drones started to"
  },
  {
    "startMs": 238400,
    "text": "become a lot more available and they"
  },
  {
    "startMs": 240560,
    "text": "started to become a tool. A lot of"
  },
  {
    "startMs": 242239,
    "text": "industries out there started to use"
  },
  {
    "startMs": 243599,
    "text": "them. They will carry them with them in"
  },
  {
    "startMs": 244959,
    "text": "the truck, go out there, deploy it. And"
  },
  {
    "startMs": 247680,
    "text": "the next era that we're working towards"
  },
  {
    "startMs": 249280,
    "text": "is drones as infrastructure. Imagine"
  },
  {
    "startMs": 251200,
    "text": "these systems. And for the sake of this"
  },
  {
    "startMs": 253360,
    "text": "conference, I'm going to call them"
  },
  {
    "startMs": 254319,
    "text": "agents. These are physical emboded"
  },
  {
    "startMs": 256079,
    "text": "agents that are kind of available at all"
  },
  {
    "startMs": 258720,
    "text": "times at anywhere for the different sort"
  },
  {
    "startMs": 260479,
    "text": "of use cases that we're interested in"
  },
  {
    "startMs": 262479,
    "text": "that can automatically uh uh launch,"
  },
  {
    "startMs": 265120,
    "text": "execute, and do their tasks. And what is"
  },
  {
    "startMs": 267840,
    "text": "the minimum amount of autonomy that"
  },
  {
    "startMs": 269360,
    "text": "needs to be begged in? And what does the"
  },
  {
    "startMs": 270639,
    "text": "future interface look like today?"
  },
  {
    "startMs": 272960,
    "text": "Everyone needs to be a dedicated pilot."
  },
  {
    "startMs": 275040,
    "text": "I go went through a certification"
  },
  {
    "startMs": 276479,
    "text": "exercise. I need to think about the"
  },
  {
    "startMs": 277759,
    "text": "safety standards here. But you can"
  },
  {
    "startMs": 279360,
    "text": "imagine in a few years time the safety"
  },
  {
    "startMs": 282160,
    "text": "is going to be determined by the"
  },
  {
    "startMs": 283440,
    "text": "autonomous system and the interface"
  },
  {
    "startMs": 286160,
    "text": "becomes really high level. It could be a"
  },
  {
    "startMs": 288400,
    "text": "little slack bot that says, \"Hey,"
  },
  {
    "startMs": 289759,
    "text": "something's happened here. Why don't we"
  },
  {
    "startMs": 291280,
    "text": "go send a drone?\" And you might not even"
  },
  {
    "startMs": 292880,
    "text": "know that the drone launched."
  },
  {
    "startMs": 295280,
    "text": "So, while this is happening, I'm going"
  },
  {
    "startMs": 297280,
    "text": "to tell all the drones to pause and"
  },
  {
    "startMs": 299199,
    "text": "return to doc."
  },
  {
    "startMs": 303600,
    "text": "So, we'll write this. They're all going"
  },
  {
    "startMs": 305919,
    "text": "to start returning to doc. And while"
  },
  {
    "startMs": 307280,
    "text": "that's happening, I'm going to start on"
  },
  {
    "startMs": 308560,
    "text": "the presentation."
  },
  {
    "startMs": 314320,
    "text": "So, what I've shown you here is not just"
  },
  {
    "startMs": 316400,
    "text": "concept. These are literally systems"
  },
  {
    "startMs": 318720,
    "text": "that are being used in production. Uh as"
  },
  {
    "startMs": 320960,
    "text": "was mentioned we are the largest"
  },
  {
    "startMs": 322320,
    "text": "manufacturer of drones in the US and we"
  },
  {
    "startMs": 324400,
    "text": "want to give people superpowers uh"
  },
  {
    "startMs": 325919,
    "text": "through this technology."
  },
  {
    "startMs": 328720,
    "text": "Let's take a quick look at what some of"
  },
  {
    "startMs": 330240,
    "text": "the people are doing here. This is um in"
  },
  {
    "startMs": 332080,
    "text": "the northeast coast of the US uh where"
  },
  {
    "startMs": 334479,
    "text": "our client has set up uh the system next"
  },
  {
    "startMs": 337120,
    "text": "to a power station and they kind of used"
  },
  {
    "startMs": 339199,
    "text": "this to do normal patrols and as they"
  },
  {
    "startMs": 340880,
    "text": "flew around they found that some of the"
  },
  {
    "startMs": 343440,
    "text": "there was a the pole was burning from"
  },
  {
    "startMs": 345520,
    "text": "the inside and it was really starting to"
  },
  {
    "startMs": 347120,
    "text": "show up here and this could have fallen"
  },
  {
    "startMs": 348639,
    "text": "at any time and created a fire risk that"
  },
  {
    "startMs": 350720,
    "text": "they would have otherwise not caught"
  },
  {
    "startMs": 352880,
    "text": "without having to send people there"
  },
  {
    "startMs": 354320,
    "text": "which itself is quite uh expensive."
  },
  {
    "startMs": 359919,
    "text": "Moving on to the sort of next use case"
  },
  {
    "startMs": 361600,
    "text": "is on the public safety side. This is"
  },
  {
    "startMs": 363680,
    "text": "San Francisco. Uh we work very closely"
  },
  {
    "startMs": 366080,
    "text": "with SFPD. Um normally when a car gets"
  },
  {
    "startMs": 368960,
    "text": "stolen, you'll see a high-speed chase"
  },
  {
    "startMs": 370560,
    "text": "happening in the city. Quite dangerous."
  },
  {
    "startMs": 372560,
    "text": "But what if you could deploy a drone"
  },
  {
    "startMs": 373919,
    "text": "instead where the uh people in the car"
  },
  {
    "startMs": 376319,
    "text": "don't even know that there's a drone"
  },
  {
    "startMs": 378319,
    "text": "following them. Here's a person who has"
  },
  {
    "startMs": 380479,
    "text": "stolen the car on the right hand side"
  },
  {
    "startMs": 382080,
    "text": "and they're about to change their"
  },
  {
    "startMs": 383280,
    "text": "license plates uh on that. So they go"
  },
  {
    "startMs": 387600,
    "text": "here, get out their tools. They come"
  },
  {
    "startMs": 389600,
    "text": "back, luckily they point the license"
  },
  {
    "startMs": 391039,
    "text": "plate up so the drone can see it and we"
  },
  {
    "startMs": 392880,
    "text": "know exactly what they're doing. But"
  },
  {
    "startMs": 394319,
    "text": "they're now replacing the plate uh in"
  },
  {
    "startMs": 396400,
    "text": "the car uh with a new one. And all this"
  },
  {
    "startMs": 399120,
    "text": "time they don't know that there's"
  },
  {
    "startMs": 400240,
    "text": "they're being chased. The the the how"
  },
  {
    "startMs": 402560,
    "text": "they behave in the uh public, how they"
  },
  {
    "startMs": 405120,
    "text": "behave out there is very different and"
  },
  {
    "startMs": 406720,
    "text": "it's a lot safer uh in how the"
  },
  {
    "startMs": 408880,
    "text": "operations are done. They're now going"
  },
  {
    "startMs": 410319,
    "text": "to go ahead and tint the windows. uh but"
  },
  {
    "startMs": 412960,
    "text": "this allows the police to like"
  },
  {
    "startMs": 414560,
    "text": "strategically position themselves in the"
  },
  {
    "startMs": 416400,
    "text": "most safest way form to intervene at the"
  },
  {
    "startMs": 419599,
    "text": "right time rather than doing a"
  },
  {
    "startMs": 420800,
    "text": "high-speed chase outside."
  },
  {
    "startMs": 424639,
    "text": "So these are being used across many"
  },
  {
    "startMs": 426400,
    "text": "different industries"
  },
  {
    "startMs": 428880,
    "text": "and we are really starting to treat this"
  },
  {
    "startMs": 431360,
    "text": "as infrastructure that can operate day"
  },
  {
    "startMs": 433280,
    "text": "in day out nighttime rain sunshine."
  },
  {
    "startMs": 436160,
    "text": "We've got a few of these docs deployed"
  },
  {
    "startMs": 437520,
    "text": "in Alaska, so very cold weathers. Few of"
  },
  {
    "startMs": 439520,
    "text": "these docks deployed in uh Texas, so"
  },
  {
    "startMs": 441440,
    "text": "extreme heat. And these need to be"
  },
  {
    "startMs": 443360,
    "text": "reliable down to 99.9999%"
  },
  {
    "startMs": 446319,
    "text": "uh where we do our sort of simulation"
  },
  {
    "startMs": 448000,
    "text": "and testing to be able to prove that."
  },
  {
    "startMs": 449840,
    "text": "And today, uh we have about 16 million"
  },
  {
    "startMs": 453120,
    "text": "people living within 2 mi radius of this"
  },
  {
    "startMs": 455199,
    "text": "infrastructure that the uh um public"
  },
  {
    "startMs": 458160,
    "text": "safety, the power companies can kind of"
  },
  {
    "startMs": 460080,
    "text": "use this technology to be able to"
  },
  {
    "startMs": 461840,
    "text": "respond to such incidents without having"
  },
  {
    "startMs": 463360,
    "text": "to travel there."
  },
  {
    "startMs": 465440,
    "text": "So, what really happens when this"
  },
  {
    "startMs": 467840,
    "text": "happens at scale? Can I get a hands up"
  },
  {
    "startMs": 469440,
    "text": "of people that have flown a drone"
  },
  {
    "startMs": 470639,
    "text": "before? A couple of hands up. When I"
  },
  {
    "startMs": 473199,
    "text": "started to fly it, it was like kind It"
  },
  {
    "startMs": 475280,
    "text": "took me a few hours to like really"
  },
  {
    "startMs": 476560,
    "text": "figure it out. Then I put on the FPV,"
  },
  {
    "startMs": 478639,
    "text": "that was even more tricky, but it felt"
  },
  {
    "startMs": 480800,
    "text": "good to get get that expertise up, but"
  },
  {
    "startMs": 482400,
    "text": "it's kind of like a skill that you"
  },
  {
    "startMs": 483599,
    "text": "develop and you develop that skill over"
  },
  {
    "startMs": 486400,
    "text": "time and you say, \"Okay, for each"
  },
  {
    "startMs": 488319,
    "text": "skilled person, we're going to put them"
  },
  {
    "startMs": 489599,
    "text": "next to a drone and they're going to"
  },
  {
    "startMs": 491120,
    "text": "start working.\" But now you want more of"
  },
  {
    "startMs": 493919,
    "text": "these. So, uh, police companies,"
  },
  {
    "startMs": 496080,
    "text": "infrastructure companies need to start"
  },
  {
    "startMs": 497440,
    "text": "hiring these people more. And at some"
  },
  {
    "startMs": 499440,
    "text": "stage, this really starts to break down."
  },
  {
    "startMs": 500879,
    "text": "The more 911 calls come that come in,"
  },
  {
    "startMs": 502720,
    "text": "the more alerts that can come in, it"
  },
  {
    "startMs": 504319,
    "text": "doesn't really scale. So, we kind of"
  },
  {
    "startMs": 506960,
    "text": "rethinking as to what this means in"
  },
  {
    "startMs": 508560,
    "text": "terms of this like initial firsterson"
  },
  {
    "startMs": 510479,
    "text": "view engagement with these systems to"
  },
  {
    "startMs": 512800,
    "text": "how do we convert this to a more"
  },
  {
    "startMs": 514240,
    "text": "strategic uh, multi- aent view that you"
  },
  {
    "startMs": 517200,
    "text": "can kind of command the entire fleet"
  },
  {
    "startMs": 518719,
    "text": "with an objective in mind without having"
  },
  {
    "startMs": 520800,
    "text": "to worry about the flight. Let me just"
  },
  {
    "startMs": 523200,
    "text": "go back and see if that was all working"
  },
  {
    "startMs": 524560,
    "text": "well. Great. They all landed. I am still"
  },
  {
    "startMs": 526959,
    "text": "pleased when that happens successfully."
  },
  {
    "startMs": 528800,
    "text": "Although it's meant to happen all the"
  },
  {
    "startMs": 530080,
    "text": "time."
  },
  {
    "startMs": 531920,
    "text": "All right, let's go back to this."
  },
  {
    "startMs": 535200,
    "text": "Oh,"
  },
  {
    "startMs": 538080,
    "text": "all right. We're just going to carry on."
  },
  {
    "startMs": 542640,
    "text": "So, what does that mean when we start to"
  },
  {
    "startMs": 544640,
    "text": "launch different things? You saw me"
  },
  {
    "startMs": 545839,
    "text": "launch them. I was still kind of"
  },
  {
    "startMs": 547200,
    "text": "thinking about it. Okay, I need to"
  },
  {
    "startMs": 548800,
    "text": "launch this one, that one, that one. And"
  },
  {
    "startMs": 551279,
    "text": "even myself in this like uh who's used"
  },
  {
    "startMs": 554160,
    "text": "to this, I'm going to have some"
  },
  {
    "startMs": 555120,
    "text": "cognitive challenges where our vision is"
  },
  {
    "startMs": 556720,
    "text": "to be able to launch uh many many of"
  },
  {
    "startMs": 558800,
    "text": "them uh in a potentially unsupervised"
  },
  {
    "startMs": 561200,
    "text": "way. So what sort of commands these"
  },
  {
    "startMs": 562720,
    "text": "things? How do we get it to like just"
  },
  {
    "startMs": 564480,
    "text": "hey get out there, launch, search in"
  },
  {
    "startMs": 566720,
    "text": "this area, find a missing person or look"
  },
  {
    "startMs": 568720,
    "text": "out for this type of car and hold your"
  },
  {
    "startMs": 570720,
    "text": "position there."
  },
  {
    "startMs": 572560,
    "text": "And in order to do that, we really need"
  },
  {
    "startMs": 574320,
    "text": "to think about how do we get like really"
  },
  {
    "startMs": 576640,
    "text": "like the many nines of reliability that"
  },
  {
    "startMs": 579120,
    "text": "we need in autonomous flight. And that's"
  },
  {
    "startMs": 582480,
    "text": "where we get an edge in the industry"
  },
  {
    "startMs": 584800,
    "text": "because at Sky we're sort of controlling"
  },
  {
    "startMs": 586560,
    "text": "the hardware, the software, the cloud,"
  },
  {
    "startMs": 588480,
    "text": "the user interface to be able to manage"
  },
  {
    "startMs": 590320,
    "text": "all that and specifically the autonomy."
  },
  {
    "startMs": 592640,
    "text": "uh allowing us to think about how our"
  },
  {
    "startMs": 594800,
    "text": "underlying vision system should work to"
  },
  {
    "startMs": 597120,
    "text": "see the environment to behave in the"
  },
  {
    "startMs": 599120,
    "text": "environment correctly whether it's at"
  },
  {
    "startMs": 600640,
    "text": "high altitudes whether it's cloudy"
  },
  {
    "startMs": 602720,
    "text": "whether it's at high speeds how do we"
  },
  {
    "startMs": 604720,
    "text": "deal in the rain on the bottom left"
  },
  {
    "startMs": 606560,
    "text": "we're showing how do we navigate in"
  },
  {
    "startMs": 607920,
    "text": "cities how do we plan large scale and be"
  },
  {
    "startMs": 610640,
    "text": "able to do that and for anyone that has"
  },
  {
    "startMs": 612640,
    "text": "worked with any sort of GPS device in"
  },
  {
    "startMs": 614320,
    "text": "the city even our phones they kind of"
  },
  {
    "startMs": 616000,
    "text": "suck uh so how do we robustly do that"
  },
  {
    "startMs": 618800,
    "text": "and how do we also like do tracking when"
  },
  {
    "startMs": 620720,
    "text": "there's a lot of occlusion"
  },
  {
    "startMs": 622240,
    "text": "These are the all the different places"
  },
  {
    "startMs": 624160,
    "text": "where we're thinking about how to train"
  },
  {
    "startMs": 625839,
    "text": "AI systems quote unquote models. The"
  },
  {
    "startMs": 628480,
    "text": "word model itself is uh has different"
  },
  {
    "startMs": 630720,
    "text": "meanings in different places and I'll"
  },
  {
    "startMs": 632000,
    "text": "discuss a little bit on what that means"
  },
  {
    "startMs": 633360,
    "text": "for us."
  },
  {
    "startMs": 637040,
    "text": "But in order for us to you like really"
  },
  {
    "startMs": 639440,
    "text": "harness this is we are learning on the"
  },
  {
    "startMs": 641680,
    "text": "go. This is a learning flywheel that"
  },
  {
    "startMs": 643360,
    "text": "we're getting out there, we're"
  },
  {
    "startMs": 644240,
    "text": "collecting data, we're operating, and"
  },
  {
    "startMs": 646240,
    "text": "we're coming back and doing that so that"
  },
  {
    "startMs": 648560,
    "text": "each flight we can log the data. Uh kind"
  },
  {
    "startMs": 650959,
    "text": "of like Google Street View where we need"
  },
  {
    "startMs": 652800,
    "text": "to think about sanitizing that data,"
  },
  {
    "startMs": 654240,
    "text": "make sure there's no private information"
  },
  {
    "startMs": 655680,
    "text": "left there. Uh and make sure we don't"
  },
  {
    "startMs": 657839,
    "text": "sort of like uh uh the customers know"
  },
  {
    "startMs": 660000,
    "text": "exactly what they're sharing with us."
  },
  {
    "startMs": 661519,
    "text": "But if we can once we do that, we have"
  },
  {
    "startMs": 663360,
    "text": "access to a huge amounts of data that we"
  },
  {
    "startMs": 665120,
    "text": "can kind of learn from every single time"
  },
  {
    "startMs": 667040,
    "text": "we instructed this but the drone did"
  },
  {
    "startMs": 668640,
    "text": "this. every single time. We thought this"
  },
  {
    "startMs": 670160,
    "text": "was going to happen, but this happened."
  },
  {
    "startMs": 671680,
    "text": "That can come back to our uh learning"
  },
  {
    "startMs": 674160,
    "text": "agents, our reinforcement learning"
  },
  {
    "startMs": 675680,
    "text": "ecosystems to be able to retrain,"
  },
  {
    "startMs": 677839,
    "text": "evaluate, and send it back out there and"
  },
  {
    "startMs": 679760,
    "text": "kind of continue that flywheel that"
  },
  {
    "startMs": 681760,
    "text": "allows us to uh have that robust"
  },
  {
    "startMs": 683680,
    "text": "framework."
  },
  {
    "startMs": 685519,
    "text": "And the other added advantage that we"
  },
  {
    "startMs": 687200,
    "text": "have is it's not just about having"
  },
  {
    "startMs": 689040,
    "text": "autonomy on the drone. As I mentioned"
  },
  {
    "startMs": 690560,
    "text": "earlier, we have the luxury now to have"
  },
  {
    "startMs": 693120,
    "text": "autonomy on the edge device, but also"
  },
  {
    "startMs": 696000,
    "text": "have autonomy on the cloud. what I was"
  },
  {
    "startMs": 697760,
    "text": "showing you earlier, all that video"
  },
  {
    "startMs": 699200,
    "text": "feed, all the telemetry that's going"
  },
  {
    "startMs": 700959,
    "text": "through a cloud server. We could set up"
  },
  {
    "startMs": 702640,
    "text": "GPUs and we could set up inference"
  },
  {
    "startMs": 704079,
    "text": "engines there to be able to have that"
  },
  {
    "startMs": 706160,
    "text": "heavier lifting, maybe that longerterm"
  },
  {
    "startMs": 708399,
    "text": "planning there, whereas the immediate"
  },
  {
    "startMs": 710399,
    "text": "autonomous actions happen on the drone"
  },
  {
    "startMs": 712079,
    "text": "and kind of always thinking about the"
  },
  {
    "startMs": 713760,
    "text": "trade-off that we need to make uh to"
  },
  {
    "startMs": 715680,
    "text": "make that successful."
  },
  {
    "startMs": 717839,
    "text": "One thing is true, however, that uh once"
  },
  {
    "startMs": 719920,
    "text": "you do start thinking about having your"
  },
  {
    "startMs": 721680,
    "text": "agents from the cloud, this the amount"
  },
  {
    "startMs": 724079,
    "text": "of data coming to the cloud really"
  },
  {
    "startMs": 725920,
    "text": "matters. Uh here's us sort of investing"
  },
  {
    "startMs": 728959,
    "text": "in how we think about enabling the best"
  },
  {
    "startMs": 731760,
    "text": "um uh video quality coming up through to"
  },
  {
    "startMs": 734560,
    "text": "the servers uh in uh low lower low sort"
  },
  {
    "startMs": 737200,
    "text": "of bandwidth areas. Uh being able to"
  },
  {
    "startMs": 739440,
    "text": "sort of optimize that being able to un"
  },
  {
    "startMs": 742240,
    "text": "uh um encode that information into"
  },
  {
    "startMs": 744639,
    "text": "smaller sizes and be able to decode into"
  },
  {
    "startMs": 746639,
    "text": "something clear that allows us to have"
  },
  {
    "startMs": 749120,
    "text": "much higher quality exact same sort of"
  },
  {
    "startMs": 751040,
    "text": "network conditions here. uh and it's the"
  },
  {
    "startMs": 753519,
    "text": "some of the areas of investments that we"
  },
  {
    "startMs": 755040,
    "text": "make so that we can have this more"
  },
  {
    "startMs": 756720,
    "text": "cloud-based infrastructure uh to be able"
  },
  {
    "startMs": 759120,
    "text": "to manage this at scale."
  },
  {
    "startMs": 761600,
    "text": "So once we do that I want to sort of"
  },
  {
    "startMs": 763600,
    "text": "explore at a high level some of the uh"
  },
  {
    "startMs": 766160,
    "text": "models that we um uh have in our system"
  },
  {
    "startMs": 769920,
    "text": "uh that allows us to orchestrate all of"
  },
  {
    "startMs": 771839,
    "text": "this."
  },
  {
    "startMs": 773920,
    "text": "Firstly a model this is a section about"
  },
  {
    "startMs": 776079,
    "text": "world models. I want to sort of talk"
  },
  {
    "startMs": 777600,
    "text": "about world models from a context of"
  },
  {
    "startMs": 779040,
    "text": "maps. Not too dissimilar to how uh Whimo"
  },
  {
    "startMs": 782560,
    "text": "works. They have a map of the world and"
  },
  {
    "startMs": 784240,
    "text": "they kind of navigate in that world."
  },
  {
    "startMs": 785600,
    "text": "They do local perception, but also think"
  },
  {
    "startMs": 787680,
    "text": "about global planning. If I want to go"
  },
  {
    "startMs": 789120,
    "text": "from part A of the city to part B, I"
  },
  {
    "startMs": 792000,
    "text": "can't just like keep hitting every"
  },
  {
    "startMs": 793360,
    "text": "building and kind of navigating around"
  },
  {
    "startMs": 794639,
    "text": "them. I need to think about what's the"
  },
  {
    "startMs": 795920,
    "text": "optimal path uh along the way. So, we"
  },
  {
    "startMs": 798720,
    "text": "start off with a lot of prior"
  },
  {
    "startMs": 799920,
    "text": "information. uh um and we merge that"
  },
  {
    "startMs": 802800,
    "text": "with uh not just sort of building data,"
  },
  {
    "startMs": 805200,
    "text": "but maybe there's uh vector data such as"
  },
  {
    "startMs": 808160,
    "text": "where the power lines are, where the"
  },
  {
    "startMs": 810000,
    "text": "roads are, if you want different"
  },
  {
    "startMs": 811279,
    "text": "behavior in these areas. And we think"
  },
  {
    "startMs": 813519,
    "text": "about how to combine these resources to"
  },
  {
    "startMs": 816399,
    "text": "ultimately build a map that we can plan"
  },
  {
    "startMs": 818000,
    "text": "and navigate around. And the drone has"
  },
  {
    "startMs": 820160,
    "text": "knowledge of this map uh at all times to"
  },
  {
    "startMs": 822160,
    "text": "be able to go around that."
  },
  {
    "startMs": 825040,
    "text": "But like any map, maps can go out of"
  },
  {
    "startMs": 827760,
    "text": "date. Uh luckily we have so many eyes in"
  },
  {
    "startMs": 831839,
    "text": "the sky to think about how to maintain"
  },
  {
    "startMs": 834240,
    "text": "and update these maps along the way. On"
  },
  {
    "startMs": 836800,
    "text": "the left hand side uh we are rendering"
  },
  {
    "startMs": 839199,
    "text": "our knowledge of the world in the points"
  },
  {
    "startMs": 843120,
    "text": "onto our video feed. However, that"
  },
  {
    "startMs": 846639,
    "text": "doesn't line up perfectly everywhere. Uh"
  },
  {
    "startMs": 848639,
    "text": "there's some sections here that um if I"
  },
  {
    "startMs": 851279,
    "text": "sort of zoom out here, there's some"
  },
  {
    "startMs": 852800,
    "text": "sections here that a new construction"
  },
  {
    "startMs": 855040,
    "text": "site had set up uh that we did not know"
  },
  {
    "startMs": 858320,
    "text": "about. Uh however as a drone now starts"
  },
  {
    "startMs": 860800,
    "text": "to fly and not this is not just one"
  },
  {
    "startMs": 862480,
    "text": "drone but your fleet of drone they're"
  },
  {
    "startMs": 864240,
    "text": "now observing these things that we can"
  },
  {
    "startMs": 865760,
    "text": "feed back into our uh map syncing"
  },
  {
    "startMs": 868480,
    "text": "process that can come back land give the"
  },
  {
    "startMs": 870720,
    "text": "data and now once uh in the next"
  },
  {
    "startMs": 872880,
    "text": "iteration all the drones in the fleet"
  },
  {
    "startMs": 874720,
    "text": "have this most updated map of the world"
  },
  {
    "startMs": 876959,
    "text": "that they can uh do all the planning in."
  },
  {
    "startMs": 884959,
    "text": "A second type of model is uh perhaps"
  },
  {
    "startMs": 887040,
    "text": "today a more conventional sort of uh"
  },
  {
    "startMs": 889839,
    "text": "machine learning uh inference model uh"
  },
  {
    "startMs": 892800,
    "text": "which is the ability to uh be able to"
  },
  {
    "startMs": 896320,
    "text": "track understand objects in the scene"
  },
  {
    "startMs": 898480,
    "text": "but be able to track them be able to"
  },
  {
    "startMs": 900160,
    "text": "track them behind occlusions. So the uh"
  },
  {
    "startMs": 903120,
    "text": "this implicit representation behind the"
  },
  {
    "startMs": 905040,
    "text": "scene is some sort of world"
  },
  {
    "startMs": 906320,
    "text": "representation of the object that hey"
  },
  {
    "startMs": 908320,
    "text": "it's gone behind this building and it"
  },
  {
    "startMs": 909680,
    "text": "might come out on the other side. So I"
  },
  {
    "startMs": 911680,
    "text": "should navigate myself so I can kind of"
  },
  {
    "startMs": 913440,
    "text": "follow it there or I should move myself"
  },
  {
    "startMs": 915199,
    "text": "in a different direction to be able to"
  },
  {
    "startMs": 917360,
    "text": "do that. Maybe 5 years ago this would be"
  },
  {
    "startMs": 919839,
    "text": "more done uh in a more conventional way."
  },
  {
    "startMs": 921920,
    "text": "You have to like manually think about"
  },
  {
    "startMs": 923120,
    "text": "how to move. But now you can think about"
  },
  {
    "startMs": 925360,
    "text": "uh more reinforcement learning style"
  },
  {
    "startMs": 926959,
    "text": "techniques or more learned end to-end"
  },
  {
    "startMs": 928639,
    "text": "approaches that can really help out here"
  },
  {
    "startMs": 930639,
    "text": "without you having to engineer all the"
  },
  {
    "startMs": 932399,
    "text": "edge cases uh that can go in. And then"
  },
  {
    "startMs": 935440,
    "text": "obviously like how do we do this"
  },
  {
    "startMs": 936639,
    "text": "robustly rain, snow, day, night um uh"
  },
  {
    "startMs": 940720,
    "text": "using um vision only."
  },
  {
    "startMs": 944880,
    "text": "One other thing that we're sort of doing"
  },
  {
    "startMs": 946160,
    "text": "here on the tracking side is we have"
  },
  {
    "startMs": 947920,
    "text": "some minimal set of tracking that's"
  },
  {
    "startMs": 949440,
    "text": "happened on device on the edge but we"
  },
  {
    "startMs": 951519,
    "text": "can do some higher level tracking that"
  },
  {
    "startMs": 953120,
    "text": "happens on the cloud. So perhaps it can"
  },
  {
    "startMs": 954880,
    "text": "reason more about your entire map."
  },
  {
    "startMs": 956639,
    "text": "Perhaps you can reason more about use"
  },
  {
    "startMs": 958639,
    "text": "heavier models. Use VLMs uh uh with"
  },
  {
    "startMs": 961279,
    "text": "lower which have u which don't respond"
  },
  {
    "startMs": 963440,
    "text": "as quickly uh at a rate of like let's"
  },
  {
    "startMs": 965839,
    "text": "say 7 to 10 hertz but can give you"
  },
  {
    "startMs": 968240,
    "text": "feedback at a 1 to two second uh latency"
  },
  {
    "startMs": 970800,
    "text": "but that's good enough for us to make uh"
  },
  {
    "startMs": 972560,
    "text": "broad decisions about um where to move."
  },
  {
    "startMs": 976800,
    "text": "For a lot of our um infrastructure"
  },
  {
    "startMs": 979120,
    "text": "customers uh we're doing a lot of"
  },
  {
    "startMs": 981199,
    "text": "semantic reasoning. So what is there in"
  },
  {
    "startMs": 983360,
    "text": "the scene? Uh here is an illustration of"
  },
  {
    "startMs": 985920,
    "text": "us thinking about um uh utility poles"
  },
  {
    "startMs": 988800,
    "text": "and we want to uh when a instruction"
  },
  {
    "startMs": 991440,
    "text": "comes in hey go look at this line"
  },
  {
    "startMs": 993040,
    "text": "there's something gone wrong the drone"
  },
  {
    "startMs": 994800,
    "text": "needs to go there it needs to understand"
  },
  {
    "startMs": 996240,
    "text": "the scene then it needs to take actions"
  },
  {
    "startMs": 997920,
    "text": "within that scene and we're constantly"
  },
  {
    "startMs": 999759,
    "text": "looking at how to build these primitives"
  },
  {
    "startMs": 1001519,
    "text": "these tools ultimately uh that uh we"
  },
  {
    "startMs": 1004880,
    "text": "today code but uh at any time an agent"
  },
  {
    "startMs": 1007040,
    "text": "can access these tools to better"
  },
  {
    "startMs": 1009120,
    "text": "understand uh what the drone is seeing"
  },
  {
    "startMs": 1010880,
    "text": "and what it could do about"
  },
  {
    "startMs": 1014959,
    "text": "So an example of uh the agentic sort of"
  },
  {
    "startMs": 1017759,
    "text": "system in action is a visual language"
  },
  {
    "startMs": 1019920,
    "text": "model on the top left side. The user"
  },
  {
    "startMs": 1021839,
    "text": "here is typing in look for a white jeep"
  },
  {
    "startMs": 1025280,
    "text": "uh and it's doing a sort of find and"
  },
  {
    "startMs": 1027280,
    "text": "follow. It in it uh accesses a drone API"
  },
  {
    "startMs": 1030640,
    "text": "to command a certain sort of trajectory"
  },
  {
    "startMs": 1032319,
    "text": "that it should take. While that is"
  },
  {
    "startMs": 1034079,
    "text": "happening the detection head is kind of"
  },
  {
    "startMs": 1035919,
    "text": "uh the V uh the VLM is kind of running"
  },
  {
    "startMs": 1038240,
    "text": "here to say hey what's what in the scene"
  },
  {
    "startMs": 1040319,
    "text": "am I looking for? it finds something,"
  },
  {
    "startMs": 1042319,
    "text": "then it has access to the tools that"
  },
  {
    "startMs": 1044000,
    "text": "allow the drone to track and follow. And"
  },
  {
    "startMs": 1046720,
    "text": "that's without any specific coding of"
  },
  {
    "startMs": 1049120,
    "text": "that law rules, but instead uh having a"
  },
  {
    "startMs": 1051840,
    "text": "more sort of agentic uh giving the"
  },
  {
    "startMs": 1053760,
    "text": "agents the all the tools that it needs"
  },
  {
    "startMs": 1055679,
    "text": "to be able to um understand the drone"
  },
  {
    "startMs": 1057760,
    "text": "state and make decisions given the uh"
  },
  {
    "startMs": 1060160,
    "text": "information and the context that's"
  },
  {
    "startMs": 1061440,
    "text": "available there."
  },
  {
    "startMs": 1065600,
    "text": "And then there's uh always the sort of"
  },
  {
    "startMs": 1067440,
    "text": "long-term vision uh that's often there"
  },
  {
    "startMs": 1069600,
    "text": "in the self-driving community here right"
  },
  {
    "startMs": 1071360,
    "text": "now or any sort of robotic system. What"
  },
  {
    "startMs": 1073520,
    "text": "if uh we could just give it raw sensor"
  },
  {
    "startMs": 1076640,
    "text": "data and out comes uh the perfect uh"
  },
  {
    "startMs": 1080320,
    "text": "results. Uh perhaps that's the actuation"
  },
  {
    "startMs": 1083120,
    "text": "that happens. Perhaps it's where the"
  },
  {
    "startMs": 1084640,
    "text": "drone is pointing. Perhaps it's where"
  },
  {
    "startMs": 1085919,
    "text": "the drone goes. And we're definitely"
  },
  {
    "startMs": 1087679,
    "text": "sort of doing a lot of testing and"
  },
  {
    "startMs": 1088799,
    "text": "triing with reinforcement learning on"
  },
  {
    "startMs": 1090480,
    "text": "what that looks like if we have multiple"
  },
  {
    "startMs": 1093039,
    "text": "uh instantiations of uh this um"
  },
  {
    "startMs": 1095919,
    "text": "behavior. Does it get to the right um"
  },
  {
    "startMs": 1098720,
    "text": "end spectrum? The main consideration"
  },
  {
    "startMs": 1100799,
    "text": "whenever we work with a physical system"
  },
  {
    "startMs": 1103360,
    "text": "is that you're often looking at really"
  },
  {
    "startMs": 1106160,
    "text": "high volumes of reliability as I was"
  },
  {
    "startMs": 1108640,
    "text": "saying many nines of reliability. uh and"
  },
  {
    "startMs": 1111520,
    "text": "the um doing a completely end to-end"
  },
  {
    "startMs": 1114880,
    "text": "system uh does have its challenges in"
  },
  {
    "startMs": 1116880,
    "text": "the sense that the observability of"
  },
  {
    "startMs": 1118320,
    "text": "what's going wrong and the guarantees on"
  },
  {
    "startMs": 1120000,
    "text": "reliability is very difficult today. So"
  },
  {
    "startMs": 1122000,
    "text": "while it's a direction that we're"
  },
  {
    "startMs": 1123200,
    "text": "continuously taking and exploring, it's"
  },
  {
    "startMs": 1124720,
    "text": "kind of figuring out which segments of"
  },
  {
    "startMs": 1126720,
    "text": "your end to-end chunk need to move to a"
  },
  {
    "startMs": 1128960,
    "text": "more uh um like sort of world model"
  },
  {
    "startMs": 1132960,
    "text": "representation of it. Uh, and it's"
  },
  {
    "startMs": 1135039,
    "text": "specifically the things where we always"
  },
  {
    "startMs": 1136799,
    "text": "find ourselves, okay, I need to"
  },
  {
    "startMs": 1138480,
    "text": "handgineer this. I need to code this in"
  },
  {
    "startMs": 1140480,
    "text": "specifically. I need to look at these"
  },
  {
    "startMs": 1141679,
    "text": "rules. Like search and rescue is one of"
  },
  {
    "startMs": 1143039,
    "text": "those things like, oh, go look for these"
  },
  {
    "startMs": 1144880,
    "text": "trees, but if you don't find the trees,"
  },
  {
    "startMs": 1146559,
    "text": "look under here or then turn on thermal"
  },
  {
    "startMs": 1148400,
    "text": "or but then if you didn't find it here,"
  },
  {
    "startMs": 1150160,
    "text": "look there. We're trying to get away"
  },
  {
    "startMs": 1151840,
    "text": "from having to have all these if"
  },
  {
    "startMs": 1153280,
    "text": "statements and the code and these"
  },
  {
    "startMs": 1154640,
    "text": "branching strategies and kind of let the"
  },
  {
    "startMs": 1157039,
    "text": "agent have some highle tools uh to be"
  },
  {
    "startMs": 1159440,
    "text": "able to instruct these very high level"
  },
  {
    "startMs": 1161039,
    "text": "commands uh for the drone."
  },
  {
    "startMs": 1166000,
    "text": "So um I talked about a quadcopter today,"
  },
  {
    "startMs": 1168480,
    "text": "but we're kind of doing this similar"
  },
  {
    "startMs": 1169760,
    "text": "with a much smaller from form factor"
  },
  {
    "startMs": 1172240,
    "text": "quadcopter and we're now starting to"
  },
  {
    "startMs": 1174160,
    "text": "look at this what this looks like from a"
  },
  {
    "startMs": 1175520,
    "text": "fixed wing as well. all in the world of"
  },
  {
    "startMs": 1177520,
    "text": "infrastructure. Uh so they can be"
  },
  {
    "startMs": 1179520,
    "text": "launched from anywhere, recovered from"
  },
  {
    "startMs": 1180880,
    "text": "anywhere and ultimately the sweet spot"
  },
  {
    "startMs": 1183200,
    "text": "where we can kind of start to very"
  },
  {
    "startMs": 1184720,
    "text": "quickly build on the cloud uh to"
  },
  {
    "startMs": 1186720,
    "text": "orchestrate these things. And the way we"
  },
  {
    "startMs": 1188640,
    "text": "thinking about it is allowing these"
  },
  {
    "startMs": 1190559,
    "text": "systems to have basic APIs of"
  },
  {
    "startMs": 1192480,
    "text": "interactivity that the cloud agents can"
  },
  {
    "startMs": 1194400,
    "text": "come in and uh tap into and make"
  },
  {
    "startMs": 1196640,
    "text": "decisions on and ultimately allow for"
  },
  {
    "startMs": 1199760,
    "text": "very high level thinking when we uh uh"
  },
  {
    "startMs": 1202559,
    "text": "work with these drones."
  },
  {
    "startMs": 1204960,
    "text": "So like many talks here we are hiring uh"
  },
  {
    "startMs": 1207760,
    "text": "as as I said we have full stack sort of"
  },
  {
    "startMs": 1210320,
    "text": "uh we do the end toend thing hardware"
  },
  {
    "startMs": 1212320,
    "text": "software autonomy full stack front end"
  },
  {
    "startMs": 1214400,
    "text": "back end uh wireless networking"
  },
  {
    "startMs": 1217120,
    "text": "everything all the technologies on our"
  },
  {
    "startMs": 1218880,
    "text": "mobile phones we're now making them fly"
  },
  {
    "startMs": 1221440,
    "text": "um so uh come say hi or look at our"
  },
  {
    "startMs": 1225039,
    "text": "website uh would love to talk more thank"
  }
]