[
  {
    "startMs": 1309,
    "text": "[music]"
  },
  {
    "startMs": 13759,
    "text": "Thank you for coming here to my talk to"
  },
  {
    "startMs": 16320,
    "text": "watch me talk about uh agents on the"
  },
  {
    "startMs": 18560,
    "text": "canvas. Um the first thing I'm going to"
  },
  {
    "startMs": 21439,
    "text": "do though is uh before I have to record"
  },
  {
    "startMs": 23920,
    "text": "my screen. Uh the first thing I'm going"
  },
  {
    "startMs": 25680,
    "text": "to do is I'm going to ask my agent to do"
  },
  {
    "startMs": 27840,
    "text": "something on the canvas."
  },
  {
    "startMs": 30960,
    "text": "And what I'm going to do is say, \"Hey,"
  },
  {
    "startMs": 33360,
    "text": "uh, my colleague Spencer just emailed me"
  },
  {
    "startMs": 35120,
    "text": "a link to a notion document, uh, for a"
  },
  {
    "startMs": 37120,
    "text": "really cool demo we could build with the"
  },
  {
    "startMs": 38960,
    "text": "TL desktop app. Can you like find that"
  },
  {
    "startMs": 41280,
    "text": "document and then can you build it on"
  },
  {
    "startMs": 42960,
    "text": "the desktop app?\""
  },
  {
    "startMs": 45760,
    "text": "Thank you."
  },
  {
    "startMs": 50160,
    "text": "Okay, so that's going to build uh, and"
  },
  {
    "startMs": 51840,
    "text": "then we're going to come back to it"
  },
  {
    "startMs": 52879,
    "text": "later and hopefully it'll work. Um, hi"
  },
  {
    "startMs": 55600,
    "text": "everyone, my name is Max Reich. Thanks"
  },
  {
    "startMs": 57039,
    "text": "so much for coming. Um I work on uh"
  },
  {
    "startMs": 60640,
    "text": "agents on the canvas at uh TLA. I'm a"
  },
  {
    "startMs": 63199,
    "text": "product engineer there. Um so first"
  },
  {
    "startMs": 65600,
    "text": "things first, am I qualified to be"
  },
  {
    "startMs": 67119,
    "text": "giving this talk? I like to think so."
  },
  {
    "startMs": 68960,
    "text": "I've been doing like agents on the"
  },
  {
    "startMs": 70159,
    "text": "canvas stuff since before chat GBT came"
  },
  {
    "startMs": 72240,
    "text": "out. Um I think it's really cool. I"
  },
  {
    "startMs": 74479,
    "text": "think there's like so much UX stuff you"
  },
  {
    "startMs": 76159,
    "text": "can do with when you get LM, you have"
  },
  {
    "startMs": 78320,
    "text": "them working in space. Uh and I think"
  },
  {
    "startMs": 80400,
    "text": "it's really interesting. I've been doing"
  },
  {
    "startMs": 81520,
    "text": "it for about as long as you can have"
  },
  {
    "startMs": 83119,
    "text": "been doing it. Um more recently I've"
  },
  {
    "startMs": 85520,
    "text": "been talking about this a lot. Um,"
  },
  {
    "startMs": 87439,
    "text": "here's some proof. Um, and yeah, so I"
  },
  {
    "startMs": 90720,
    "text": "work at this company called Teal Draw."
  },
  {
    "startMs": 92400,
    "text": "Um, can I get a quick show of hands? Has"
  },
  {
    "startMs": 93920,
    "text": "anybody ever heard of or used Teal Draw"
  },
  {
    "startMs": 95520,
    "text": "before?"
  },
  {
    "startMs": 96479,
    "text": ">> Yeah. Okay. Um, awesome. So, yeah, the"
  },
  {
    "startMs": 99759,
    "text": "thing that you've probably used if you"
  },
  {
    "startMs": 101360,
    "text": "use Teal Draw is, um, this app right"
  },
  {
    "startMs": 104320,
    "text": "here. So, this is all Teal Draw. Uh,"
  },
  {
    "startMs": 106320,
    "text": "this is a free uh, infinite canvas"
  },
  {
    "startMs": 108479,
    "text": "whiteboarding app. Um, you know, we have"
  },
  {
    "startMs": 110960,
    "text": "selections and arrows and resizing and,"
  },
  {
    "startMs": 113759,
    "text": "you know, all the things that you need"
  },
  {
    "startMs": 115200,
    "text": "in a in a whiteboard. Um, Traw is also"
  },
  {
    "startMs": 118320,
    "text": "the company uh that makes this app. It's"
  },
  {
    "startMs": 121200,
    "text": "based in London. It's where I work. Um,"
  },
  {
    "startMs": 123600,
    "text": "but the last thing that TLAR is, which"
  },
  {
    "startMs": 125280,
    "text": "is, I think, in my opinion, the most"
  },
  {
    "startMs": 126719,
    "text": "important, is it's the Infinite Canvas"
  },
  {
    "startMs": 128879,
    "text": "SDKs that that powers this app. Um, and"
  },
  {
    "startMs": 131920,
    "text": "so what that means is that, you know,"
  },
  {
    "startMs": 133920,
    "text": "this is kind of the teal draw. The SDK"
  },
  {
    "startMs": 135920,
    "text": "is the engine that powers a lot of"
  },
  {
    "startMs": 137360,
    "text": "Infinite canvas experiences. Um because"
  },
  {
    "startMs": 140000,
    "text": "it turns out it's really hard to get"
  },
  {
    "startMs": 141040,
    "text": "that kind of stuff right. Um and uh so"
  },
  {
    "startMs": 144800,
    "text": "if you ever want to build a Muro"
  },
  {
    "startMs": 146480,
    "text": "competitor or a slide designer or if"
  },
  {
    "startMs": 148400,
    "text": "you're like Replet um Replet has their"
  },
  {
    "startMs": 151120,
    "text": "whole new uh agent canvas stuff built on"
  },
  {
    "startMs": 153040,
    "text": "top of TLR. Um, and so the reason we"
  },
  {
    "startMs": 156480,
    "text": "built TL Draw in the first place was"
  },
  {
    "startMs": 158160,
    "text": "that we were running into this issue or"
  },
  {
    "startMs": 160160,
    "text": "people were running into this issue"
  },
  {
    "startMs": 161200,
    "text": "where they had this idea for this like"
  },
  {
    "startMs": 162560,
    "text": "really great killer canvas app. Uh, and"
  },
  {
    "startMs": 165120,
    "text": "they went to go build it and everybody"
  },
  {
    "startMs": 166480,
    "text": "would run into the same problem where"
  },
  {
    "startMs": 167760,
    "text": "they would run into"
  },
  {
    "startMs": 170000,
    "text": "they would have trouble making the"
  },
  {
    "startMs": 171120,
    "text": "actual canvas part of of the app and"
  },
  {
    "startMs": 174160,
    "text": "they would, you know, trying to deal"
  },
  {
    "startMs": 175280,
    "text": "with resizing and selection and, you"
  },
  {
    "startMs": 177040,
    "text": "know, all the matrix math. And the issue"
  },
  {
    "startMs": 179040,
    "text": "is that they wouldn't be able to build"
  },
  {
    "startMs": 180160,
    "text": "their actual app itself. They would get"
  },
  {
    "startMs": 182080,
    "text": "stuck on the canvas. And so we built"
  },
  {
    "startMs": 183280,
    "text": "Teal Draw to kind of be the engine um"
  },
  {
    "startMs": 186080,
    "text": "that could power that could be the"
  },
  {
    "startMs": 187519,
    "text": "canvas so that they could focus on the"
  },
  {
    "startMs": 189120,
    "text": "actual app. Uh when LLM came out, we"
  },
  {
    "startMs": 192159,
    "text": "like a lot of other people saw that this"
  },
  {
    "startMs": 193519,
    "text": "is going to be this weird new type of"
  },
  {
    "startMs": 195519,
    "text": "software. I don't know if anyone, you"
  },
  {
    "startMs": 197440,
    "text": "know, I'm sure a lot of you were"
  },
  {
    "startMs": 198319,
    "text": "building in 2022 and it was really"
  },
  {
    "startMs": 200080,
    "text": "exciting. Um and a lot of people it was"
  },
  {
    "startMs": 202560,
    "text": "the exact same thing. People had the"
  },
  {
    "startMs": 203840,
    "text": "idea had an idea for this cool app that"
  },
  {
    "startMs": 206319,
    "text": "would, you know, involve LM on the"
  },
  {
    "startMs": 208560,
    "text": "canvas having them manipulating things"
  },
  {
    "startMs": 210319,
    "text": "in space. but then they would try to"
  },
  {
    "startMs": 212159,
    "text": "build it and they'd get stuck. Um there"
  },
  {
    "startMs": 214000,
    "text": "were no best practices. People didn't"
  },
  {
    "startMs": 215360,
    "text": "really know how to do it. And so at TL"
  },
  {
    "startMs": 217519,
    "text": "Draw we uh realized that we need to make"
  },
  {
    "startMs": 219599,
    "text": "it easy for people to build uh with"
  },
  {
    "startMs": 221599,
    "text": "agents with LLMs on the canvas. Um and"
  },
  {
    "startMs": 225120,
    "text": "also so Teal Draw the SDK as well as the"
  },
  {
    "startMs": 227360,
    "text": "app has multiplayer built in with like"
  },
  {
    "startMs": 228879,
    "text": "live sync. It's really nice. There's"
  },
  {
    "startMs": 230720,
    "text": "cursors. There's you can see your"
  },
  {
    "startMs": 232080,
    "text": "collaborators cursors and selections and"
  },
  {
    "startMs": 233920,
    "text": "viewports. And I think all of the things"
  },
  {
    "startMs": 235760,
    "text": "that make just the canvas in general a"
  },
  {
    "startMs": 237760,
    "text": "really great uh place for interacting"
  },
  {
    "startMs": 240480,
    "text": "with and collaborating with your"
  },
  {
    "startMs": 241920,
    "text": "colleagues also make it a really great"
  },
  {
    "startMs": 244000,
    "text": "place for interacting uh and"
  },
  {
    "startMs": 245599,
    "text": "collaborating with agents. Uh and I hope"
  },
  {
    "startMs": 247519,
    "text": "I'm going to be able to show you guys"
  },
  {
    "startMs": 248799,
    "text": "some of that um in the demos that come"
  },
  {
    "startMs": 250959,
    "text": "up. Um so before we talk about agents on"
  },
  {
    "startMs": 254159,
    "text": "the canvas, uh really quickly I want to"
  },
  {
    "startMs": 255760,
    "text": "talk about agents not on the canvas. Um"
  },
  {
    "startMs": 257600,
    "text": "I'm sure you guys have all used an app"
  },
  {
    "startMs": 259199,
    "text": "that looks like this, you know, claude"
  },
  {
    "startMs": 260880,
    "text": "code. And I'm going to really"
  },
  {
    "startMs": 262320,
    "text": "oversimplify here, but basically, uh,"
  },
  {
    "startMs": 264560,
    "text": "part of the reason why these apps are so"
  },
  {
    "startMs": 266320,
    "text": "good and why they work is because"
  },
  {
    "startMs": 267840,
    "text": "they're, you know, the medium in which"
  },
  {
    "startMs": 269280,
    "text": "they're working, writing code is"
  },
  {
    "startMs": 271360,
    "text": "essentially the medium in which they"
  },
  {
    "startMs": 272479,
    "text": "were trained. You know, it's it's text"
  },
  {
    "startMs": 273680,
    "text": "in, text out. That's how they were"
  },
  {
    "startMs": 275040,
    "text": "trained. Um, and when we work with them,"
  },
  {
    "startMs": 277680,
    "text": "we give them a prompt and they write"
  },
  {
    "startMs": 279199,
    "text": "code. It's text in, text out. Uh, you"
  },
  {
    "startMs": 281440,
    "text": "know, again, oversimplifying, but that's"
  },
  {
    "startMs": 283199,
    "text": "essentially how they work. I don't know"
  },
  {
    "startMs": 285199,
    "text": "if you guys have ever, you know, tried"
  },
  {
    "startMs": 286479,
    "text": "to get your agents to do like UI stuff"
  },
  {
    "startMs": 288320,
    "text": "and try to get them align to align"
  },
  {
    "startMs": 289919,
    "text": "something. found that they could not do"
  },
  {
    "startMs": 291600,
    "text": "that whatsoever. Um because it turns out"
  },
  {
    "startMs": 294080,
    "text": "agents are really really bad at working"
  },
  {
    "startMs": 296160,
    "text": "in 2D space and understanding 2D space"
  },
  {
    "startMs": 298400,
    "text": "and actually requires like a lot of"
  },
  {
    "startMs": 300080,
    "text": "engineering work to get them to uh do"
  },
  {
    "startMs": 302400,
    "text": "it. And that's kind of the project that"
  },
  {
    "startMs": 304639,
    "text": "we've been embarking on at Teal Draw"
  },
  {
    "startMs": 306160,
    "text": "recently. Um and so the first thing we"
  },
  {
    "startMs": 308960,
    "text": "had to do, this is an older project, but"
  },
  {
    "startMs": 310479,
    "text": "the first thing we had to do is get them"
  },
  {
    "startMs": 311759,
    "text": "to teach them teach the agents or at"
  },
  {
    "startMs": 313919,
    "text": "this point not agents LLM to understand"
  },
  {
    "startMs": 316080,
    "text": "the canvas and understand kind of what"
  },
  {
    "startMs": 318080,
    "text": "they're even looking at. Um, so we had"
  },
  {
    "startMs": 320320,
    "text": "this project called teach um where um we"
  },
  {
    "startMs": 324800,
    "text": "tal So I'm going to I'm going to prompt"
  },
  {
    "startMs": 325919,
    "text": "this really quick. I'm going to say,"
  },
  {
    "startMs": 327360,
    "text": "\"Hey, make the mouse blow out the"
  },
  {
    "startMs": 328960,
    "text": "candle.\""
  },
  {
    "startMs": 331759,
    "text": "Yeah. So that's going to take a second."
  },
  {
    "startMs": 333440,
    "text": "This is this is an older uh older"
  },
  {
    "startMs": 335120,
    "text": "project, but basically what we had to do"
  },
  {
    "startMs": 337680,
    "text": "is we had to kind of like teach the LMS"
  },
  {
    "startMs": 340240,
    "text": "how to take the like the screenshot that"
  },
  {
    "startMs": 342000,
    "text": "we give it and the JSON and all of the"
  },
  {
    "startMs": 343759,
    "text": "other information about the canvas and"
  },
  {
    "startMs": 346000,
    "text": "Oh yeah, there we Okay. So yeah, that's"
  },
  {
    "startMs": 348720,
    "text": "some that's some wind. Uh it's"
  },
  {
    "startMs": 351919,
    "text": "is it sometimes it gives us smoke as"
  },
  {
    "startMs": 353440,
    "text": "well. Yeah, and we got a little smoke as"
  },
  {
    "startMs": 354720,
    "text": "well. So So we basically had to take it"
  },
  {
    "startMs": 357360,
    "text": "how to like and I want to be very clear"
  },
  {
    "startMs": 359520,
    "text": "this is not um this is not like a"
  },
  {
    "startMs": 361280,
    "text": "special mouse shape. These are just like"
  },
  {
    "startMs": 363280,
    "text": "uh you know the these are just shapes uh"
  },
  {
    "startMs": 366319,
    "text": "on the canvas. This is um and so the"
  },
  {
    "startMs": 368720,
    "text": "work behind this it's a singleshot"
  },
  {
    "startMs": 370319,
    "text": "prompt but we basically we tell the"
  },
  {
    "startMs": 372880,
    "text": "agent how to interpret uh both via"
  },
  {
    "startMs": 374880,
    "text": "screenshots and via the data um what is"
  },
  {
    "startMs": 377280,
    "text": "actually on the canvas like what it's"
  },
  {
    "startMs": 378479,
    "text": "looking at um which is actually you know"
  },
  {
    "startMs": 380319,
    "text": "it's not a trivial problem and then also"
  },
  {
    "startMs": 383440,
    "text": "how to we teach it how to actually act"
  },
  {
    "startMs": 385840,
    "text": "on the canvas and to understand how the"
  },
  {
    "startMs": 387680,
    "text": "actions that it produces will affect the"
  },
  {
    "startMs": 389360,
    "text": "canvas. So, you know, it got it, you"
  },
  {
    "startMs": 391440,
    "text": "know, it made the it made the smoke, it"
  },
  {
    "startMs": 392960,
    "text": "made the it made the wind, it got the"
  },
  {
    "startMs": 394639,
    "text": "positions right, and it understood what"
  },
  {
    "startMs": 396080,
    "text": "it was doing. Um, so we we got this we"
  },
  {
    "startMs": 399919,
    "text": "kind of figured out how the um like kind"
  },
  {
    "startMs": 402639,
    "text": "of we got we taught it what the canvas"
  },
  {
    "startMs": 404400,
    "text": "is. Uh, but this was like a single shot,"
  },
  {
    "startMs": 406080,
    "text": "single prompt kind of thing. Um, and so"
  },
  {
    "startMs": 408800,
    "text": "the next thing we built is the uh teal"
  },
  {
    "startMs": 410800,
    "text": "draw agent starter kit. Uh, which"
  },
  {
    "startMs": 412160,
    "text": "basically turns that and wraps in a"
  },
  {
    "startMs": 414000,
    "text": "harness that lets an agent work"
  },
  {
    "startMs": 415600,
    "text": "agentically on the canvas. Um, the code"
  },
  {
    "startMs": 417919,
    "text": "is also MIT licensed. You can find it on"
  },
  {
    "startMs": 420080,
    "text": "um that you can find on the website. So,"
  },
  {
    "startMs": 421919,
    "text": "here's a little here's a little cat. I'm"
  },
  {
    "startMs": 423759,
    "text": "going to make this a little bigger. Um"
  },
  {
    "startMs": 425520,
    "text": "but what I'm going to say is, \"Hey, so"
  },
  {
    "startMs": 427759,
    "text": "somewhere else on the canvas uh there"
  },
  {
    "startMs": 430160,
    "text": "are uh some friends for the cat. Can you"
  },
  {
    "startMs": 433199,
    "text": "please uh bring one of them over to the"
  },
  {
    "startMs": 434960,
    "text": "cat? Um her favorite color is red.\""
  },
  {
    "startMs": 438960,
    "text": "And so I'm going to zoom out. I'm going"
  },
  {
    "startMs": 440319,
    "text": "to show you guys what's actually going"
  },
  {
    "startMs": 441280,
    "text": "on. So you can see the the view of the"
  },
  {
    "startMs": 443039,
    "text": "agent. There's some there's some"
  },
  {
    "startMs": 444400,
    "text": "potential friends over here. And um you"
  },
  {
    "startMs": 446880,
    "text": "know if you read the All right. So and"
  },
  {
    "startMs": 449520,
    "text": "basically what's going on is that the"
  },
  {
    "startMs": 451199,
    "text": "agent has kind of like we've given it a"
  },
  {
    "startMs": 453599,
    "text": "prompt and uh using the information it"
  },
  {
    "startMs": 456400,
    "text": "has about the canvas. It's uh going to"
  },
  {
    "startMs": 459039,
    "text": "kind of like make some goals for itself."
  },
  {
    "startMs": 460479,
    "text": "You can see there's some to-dos in the"
  },
  {
    "startMs": 461759,
    "text": "corner here. It's it changed its view in"
  },
  {
    "startMs": 464160,
    "text": "order to see um what was you know the"
  },
  {
    "startMs": 468160,
    "text": "other stuff that was on the canvas. same"
  },
  {
    "startMs": 469680,
    "text": "way that if you ask a coding agent um"
  },
  {
    "startMs": 472240,
    "text": "you know you ask it you know where where"
  },
  {
    "startMs": 474639,
    "text": "do we define this thing in the codebase"
  },
  {
    "startMs": 476560,
    "text": "it can go and it can search it can find"
  },
  {
    "startMs": 478080,
    "text": "it. So this is kind of like turning that"
  },
  {
    "startMs": 480720,
    "text": "singleshot uh prompting experience into"
  },
  {
    "startMs": 483520,
    "text": "this kind of like agentic thing that you"
  },
  {
    "startMs": 485199,
    "text": "can uh have you know it can autonomously"
  },
  {
    "startMs": 487840,
    "text": "set goals and and work towards them. The"
  },
  {
    "startMs": 492879,
    "text": "uh next thing we did um we did this this"
  },
  {
    "startMs": 495919,
    "text": "uh project called fairies and so we"
  },
  {
    "startMs": 498000,
    "text": "basically we had this agent experience"
  },
  {
    "startMs": 499599,
    "text": "but we realized that you know teal draw"
  },
  {
    "startMs": 501680,
    "text": "and you know the canvas in general is so"
  },
  {
    "startMs": 503280,
    "text": "collaborative it's so multiplayer and we"
  },
  {
    "startMs": 504960,
    "text": "wanted to basically we wanted people to"
  },
  {
    "startMs": 506960,
    "text": "be able to work together with their"
  },
  {
    "startMs": 508639,
    "text": "agents and we also wanted the agents to"
  },
  {
    "startMs": 510080,
    "text": "be able to work together"
  },
  {
    "startMs": 512240,
    "text": "so this is this is a ferry um there's"
  },
  {
    "startMs": 515200,
    "text": "also you guys want to scan this QR code"
  },
  {
    "startMs": 517839,
    "text": "you can actually this is multiplayer you"
  },
  {
    "startMs": 519279,
    "text": "can join if you want you it requires a"
  },
  {
    "startMs": 521039,
    "text": "Gmail signup But you don't need to pay"
  },
  {
    "startMs": 522479,
    "text": "for tokens. Um, this is this is what the"
  },
  {
    "startMs": 524399,
    "text": "link is. So, basically, this is a this"
  },
  {
    "startMs": 526160,
    "text": "is a fairy. Um, this fair's name is is"
  },
  {
    "startMs": 528640,
    "text": "Joan. They don't like being they don't"
  },
  {
    "startMs": 530560,
    "text": "like being grabbed. Um, you can you can"
  },
  {
    "startMs": 532560,
    "text": "throw them around. You know, we added a"
  },
  {
    "startMs": 534399,
    "text": "lot of really important stuff. You can"
  },
  {
    "startMs": 535839,
    "text": "um you can you can change its hat. Um,"
  },
  {
    "startMs": 539680,
    "text": "you can change the the color and and"
  },
  {
    "startMs": 541760,
    "text": "this seems silly, but it's actually"
  },
  {
    "startMs": 543040,
    "text": "really important. uh and I'll talk about"
  },
  {
    "startMs": 544399,
    "text": "this a little bit more later, but"
  },
  {
    "startMs": 545440,
    "text": "actually understanding uh when you get a"
  },
  {
    "startMs": 547600,
    "text": "high level view of when you see your"
  },
  {
    "startMs": 548959,
    "text": "agents working on the canvas, it's"
  },
  {
    "startMs": 550320,
    "text": "important to know which one is which."
  },
  {
    "startMs": 551519,
    "text": "And so differentiating them is actually"
  },
  {
    "startMs": 552959,
    "text": "important, which is why, of course, we"
  },
  {
    "startMs": 554399,
    "text": "added the leg slider. Um"
  },
  {
    "startMs": 557760,
    "text": "but so, you know, I can say like, you"
  },
  {
    "startMs": 560000,
    "text": "know, I can I can I can say hey to it."
  },
  {
    "startMs": 562720,
    "text": "Um"
  },
  {
    "startMs": 564399,
    "text": "and I can say, you know, something like"
  },
  {
    "startMs": 566560,
    "text": "draw a cat. Uh and I can have it work."
  },
  {
    "startMs": 569360,
    "text": "But the most important thing here is"
  },
  {
    "startMs": 571040,
    "text": "that fairies have friends, right? and"
  },
  {
    "startMs": 572800,
    "text": "they can here we go. Uh"
  },
  {
    "startMs": 576000,
    "text": ">> and they can fairies can work together."
  },
  {
    "startMs": 577600,
    "text": "And so we kind of designed this like"
  },
  {
    "startMs": 578800,
    "text": "multi- aent collaboration system that"
  },
  {
    "startMs": 580640,
    "text": "works on the canvas. Um and I'm going to"
  },
  {
    "startMs": 584320,
    "text": "actually I'm going to go to"
  },
  {
    "startMs": 586800,
    "text": "I think one of my"
  },
  {
    "startMs": 589200,
    "text": "Yeah, I think so. My my colleagues"
  },
  {
    "startMs": 590560,
    "text": "agents are here working uh making this"
  },
  {
    "startMs": 592160,
    "text": "this really great scene. Um I'm going to"
  },
  {
    "startMs": 595680,
    "text": "bring mine over um summon"
  },
  {
    "startMs": 600000,
    "text": "and I'm going to give them a slightly"
  },
  {
    "startMs": 601200,
    "text": "different prompt. So, I'm gonna select"
  },
  {
    "startMs": 602160,
    "text": "them all. And now I have a group chat of"
  },
  {
    "startMs": 603839,
    "text": "of the agents, right? And I'm going to"
  },
  {
    "startMs": 605680,
    "text": "say, \"Hey, I have a board meeting coming"
  },
  {
    "startMs": 607760,
    "text": "up in like 10 minutes, and I don't have"
  },
  {
    "startMs": 609600,
    "text": "any of my my figures. Can you draw up"
  },
  {
    "startMs": 611600,
    "text": "like a little memo for all of my uh"
  },
  {
    "startMs": 613600,
    "text": "financial data for fiscal year 2025?"
  },
  {
    "startMs": 616240,
    "text": "Thank you.\""
  },
  {
    "startMs": 618800,
    "text": "Okay. So, what what's going to happen"
  },
  {
    "startMs": 620480,
    "text": "there basically is this kind of like"
  },
  {
    "startMs": 622399,
    "text": "creates this uh multi- aent, you know,"
  },
  {
    "startMs": 624399,
    "text": "coordination thing. We have uh one of"
  },
  {
    "startMs": 626959,
    "text": "the fairies is writing uh writing out a"
  },
  {
    "startMs": 629360,
    "text": "plan. You can see it. Um, and again, the"
  },
  {
    "startMs": 632800,
    "text": "animations are kind of cute and funny,"
  },
  {
    "startMs": 634079,
    "text": "but it's actually really important. I"
  },
  {
    "startMs": 635279,
    "text": "don't have to read a chat or go through,"
  },
  {
    "startMs": 637120,
    "text": "you know, imagine if I have 10 agents"
  },
  {
    "startMs": 638880,
    "text": "working. I don't have to read a chat in"
  },
  {
    "startMs": 640640,
    "text": "order to know what's actually going on."
  },
  {
    "startMs": 642399,
    "text": "I can look at the state of the agents."
  },
  {
    "startMs": 644240,
    "text": "Uh, and I can actually, you know, I can"
  },
  {
    "startMs": 646959,
    "text": "can see what's happening. So, we we have"
  },
  {
    "startMs": 650240,
    "text": "a task here that's been defined. Um,"
  },
  {
    "startMs": 654000,
    "text": "it seems like, you know, the the ferry"
  },
  {
    "startMs": 655920,
    "text": "is is uh waiting for that to to finish."
  },
  {
    "startMs": 660720,
    "text": "Yeah. So, that one's one's board. That"
  },
  {
    "startMs": 662640,
    "text": "one's waiting. So, this is the"
  },
  {
    "startMs": 663519,
    "text": "orchestrator ferry. What what it's done"
  },
  {
    "startMs": 664880,
    "text": "is it's assigned the it's assigned the"
  },
  {
    "startMs": 666720,
    "text": "task. Uh, and now it's waiting for the"
  },
  {
    "startMs": 669440,
    "text": "other ones to start and finish it. Um,"
  },
  {
    "startMs": 670959,
    "text": "and it's going to get notified. It's"
  },
  {
    "startMs": 672240,
    "text": "going to get prompted in order in order"
  },
  {
    "startMs": 673680,
    "text": "to review. Um, it seems like forever"
  },
  {
    "startMs": 676720,
    "text": "reason's not working, but thank Oh,"
  },
  {
    "startMs": 679120,
    "text": "never mind. So, yeah, we have one we"
  },
  {
    "startMs": 682480,
    "text": "have this one. So yeah, we have one"
  },
  {
    "startMs": 683920,
    "text": "fairy who made the made the task, one"
  },
  {
    "startMs": 685839,
    "text": "fairy who's working on it. And so this"
  },
  {
    "startMs": 687360,
    "text": "is this kind of um you know, multi- aent"
  },
  {
    "startMs": 690399,
    "text": "coordination system on the canvas. I"
  },
  {
    "startMs": 691760,
    "text": "have, you know, you can see my colleague"
  },
  {
    "startMs": 693040,
    "text": "has his agents over here. Uh they're"
  },
  {
    "startMs": 694959,
    "text": "they're working as well. Um and so you"
  },
  {
    "startMs": 697519,
    "text": "can kind of collaborate with people and"
  },
  {
    "startMs": 698959,
    "text": "with agents in this uh environment. And"
  },
  {
    "startMs": 701760,
    "text": "I don't know, I think that's really"
  },
  {
    "startMs": 702800,
    "text": "cool."
  },
  {
    "startMs": 704320,
    "text": "the"
  },
  {
    "startMs": 706720,
    "text": "so the the next thing. So the problem"
  },
  {
    "startMs": 709200,
    "text": "with fairies is that um they're kind of"
  },
  {
    "startMs": 712000,
    "text": "trapped in the canvas and all the stuff"
  },
  {
    "startMs": 713360,
    "text": "you've seen before. This requires if you"
  },
  {
    "startMs": 715279,
    "text": "want to build something like this, this"
  },
  {
    "startMs": 716480,
    "text": "requires like the you to like opt in and"
  },
  {
    "startMs": 719120,
    "text": "have your entire harness be a like"
  },
  {
    "startMs": 720800,
    "text": "canvas harness. Um and the downside of"
  },
  {
    "startMs": 723440,
    "text": "that is that it makes it really hard to"
  },
  {
    "startMs": 724720,
    "text": "have any of this work with stuff like"
  },
  {
    "startMs": 726240,
    "text": "outside in the real world. The fairies"
  },
  {
    "startMs": 727839,
    "text": "are the fairies are trapped in the"
  },
  {
    "startMs": 729680,
    "text": "canvas. Um, and"
  },
  {
    "startMs": 733200,
    "text": "so I I I built this experiment. We had a"
  },
  {
    "startMs": 735600,
    "text": "little hackathon uh internally. Um, but"
  },
  {
    "startMs": 738399,
    "text": "first as a quick motivation for that,"
  },
  {
    "startMs": 740320,
    "text": "um, at Teal Draw whenever we have an"
  },
  {
    "startMs": 741839,
    "text": "whenever we're getting closer to a"
  },
  {
    "startMs": 743120,
    "text": "launch, we like abandon all of our task"
  },
  {
    "startMs": 745600,
    "text": "tracking software and we make just one"
  },
  {
    "startMs": 747279,
    "text": "massive dependency graph of how like so"
  },
  {
    "startMs": 750880,
    "text": "this is what an actual this is a real"
  },
  {
    "startMs": 752240,
    "text": "thing from when we launched fairies"
  },
  {
    "startMs": 753600,
    "text": "actually. Um, and so this is what it"
  },
  {
    "startMs": 755839,
    "text": "looks like when we're like really like"
  },
  {
    "startMs": 758000,
    "text": "when is hitting the fan at at"
  },
  {
    "startMs": 759760,
    "text": "tealraw when we're launching something."
  },
  {
    "startMs": 761600,
    "text": "Um, and I really like this interface"
  },
  {
    "startMs": 764560,
    "text": "because it it kind of lets you This is"
  },
  {
    "startMs": 766079,
    "text": "not like a special app. This is still"
  },
  {
    "startMs": 767440,
    "text": "just tealraw.com. You can, you know,"
  },
  {
    "startMs": 769360,
    "text": "move your shapes around and things like"
  },
  {
    "startMs": 771040,
    "text": "that. Um, but I really like this because"
  },
  {
    "startMs": 773920,
    "text": "it both it lets you see like what"
  },
  {
    "startMs": 775839,
    "text": "depends on what. It lets you know what's"
  },
  {
    "startMs": 777200,
    "text": "coming next. It lets you get a highle"
  },
  {
    "startMs": 778800,
    "text": "overview. You know, these are all green"
  },
  {
    "startMs": 780000,
    "text": "because we finished them, but you know,"
  },
  {
    "startMs": 781760,
    "text": "you can imagine during the project, some"
  },
  {
    "startMs": 783120,
    "text": "of them are in process. And I really"
  },
  {
    "startMs": 785519,
    "text": "want I really wanted something like"
  },
  {
    "startMs": 786880,
    "text": "this. Um, but something that I could"
  },
  {
    "startMs": 789440,
    "text": "actually that could actually do the work"
  },
  {
    "startMs": 791200,
    "text": "itself. And so I um prototyped this"
  },
  {
    "startMs": 794639,
    "text": "thing. It's called the tech tree app."
  },
  {
    "startMs": 796480,
    "text": "And basically, it's similar to this."
  },
  {
    "startMs": 797600,
    "text": "It's a dependency graph, but each of"
  },
  {
    "startMs": 799760,
    "text": "these tasks um is a a coding agent that"
  },
  {
    "startMs": 803440,
    "text": "you can kick off and you can have your"
  },
  {
    "startMs": 806079,
    "text": "agent kind of like be running and doing"
  },
  {
    "startMs": 807600,
    "text": "them autonomously. Um the project itself"
  },
  {
    "startMs": 810880,
    "text": "that's working on it's this little um"
  },
  {
    "startMs": 813200,
    "text": "this is just kind of like a demo app. Um"
  },
  {
    "startMs": 815760,
    "text": "but this is Can I"
  },
  {
    "startMs": 818720,
    "text": "Yeah. So this is this is a little"
  },
  {
    "startMs": 821760,
    "text": "fun, you know, multimodal input thing. I"
  },
  {
    "startMs": 824079,
    "text": "haven't written any of the code for"
  },
  {
    "startMs": 825040,
    "text": "this. This is um this is all written by"
  },
  {
    "startMs": 827279,
    "text": "agents. But I can manage all of the work"
  },
  {
    "startMs": 829120,
    "text": "is being done in this desktop app uh or"
  },
  {
    "startMs": 831279,
    "text": "in this app here. And so I can do"
  },
  {
    "startMs": 833519,
    "text": "something like I can see this one has"
  },
  {
    "startMs": 834959,
    "text": "has finished uh building some gesture"
  },
  {
    "startMs": 837199,
    "text": "controls for the canvas. So I can open"
  },
  {
    "startMs": 839600,
    "text": "the PR uh and unfortunately sorry"
  },
  {
    "startMs": 841920,
    "text": "Jeffrey I am just going to merge this."
  },
  {
    "startMs": 843440,
    "text": "I'm not going to uh have it be explained"
  },
  {
    "startMs": 846639,
    "text": "to me. But so this is [snorts]"
  },
  {
    "startMs": 848880,
    "text": "and so yeah great. Awesome. It looks"
  },
  {
    "startMs": 850480,
    "text": "good. Um and then you know eventually"
  },
  {
    "startMs": 852320,
    "text": "this is going to get marked uh as as"
  },
  {
    "startMs": 855040,
    "text": "complete and this is also multiplayer"
  },
  {
    "startMs": 857519,
    "text": "which is really cool and you can have"
  },
  {
    "startMs": 858720,
    "text": "people working together. Yeah. So that's"
  },
  {
    "startMs": 860720,
    "text": "finished. Um and I you can also prompt"
  },
  {
    "startMs": 864560,
    "text": "from like inside the the app you can"
  },
  {
    "startMs": 867519,
    "text": "draw and have a prompt. So I can"
  },
  {
    "startMs": 868720,
    "text": "basically I can just take all of this uh"
  },
  {
    "startMs": 870800,
    "text": "and I can draw a little like so this is"
  },
  {
    "startMs": 872480,
    "text": "my prompt and I can wrap it in a task um"
  },
  {
    "startMs": 875920,
    "text": "and I can you know call it facial"
  },
  {
    "startMs": 877600,
    "text": "animation canvas control and then I can"
  },
  {
    "startMs": 881519,
    "text": "assign that to cloud and I can just hit"
  },
  {
    "startMs": 882880,
    "text": "run and so now that's working as well"
  },
  {
    "startMs": 884160,
    "text": "and so this is kind of like you know"
  },
  {
    "startMs": 886079,
    "text": "this is kind of something similar to"
  },
  {
    "startMs": 887279,
    "text": "conductor or openai symfony where you're"
  },
  {
    "startMs": 889839,
    "text": "using a kind of like one abstracted"
  },
  {
    "startMs": 891519,
    "text": "interface above uh what the actual in"
  },
  {
    "startMs": 894240,
    "text": "order to like manage your your multi-"
  },
  {
    "startMs": 895839,
    "text": "aent uh coordination and things like"
  },
  {
    "startMs": 897519,
    "text": "that And the thing I like about this"
  },
  {
    "startMs": 899040,
    "text": "also is that because this is"
  },
  {
    "startMs": 900399,
    "text": "multiplayer, one of my colleagues can"
  },
  {
    "startMs": 902000,
    "text": "come and join and add tasks and uh edit"
  },
  {
    "startMs": 904959,
    "text": "things and see the work that's been"
  },
  {
    "startMs": 906160,
    "text": "going on. So, it's much more"
  },
  {
    "startMs": 907120,
    "text": "collaborative than um like your own"
  },
  {
    "startMs": 909120,
    "text": "instance of something. Um here's the"
  },
  {
    "startMs": 912079,
    "text": "moment of truth. Let's see if that demo"
  },
  {
    "startMs": 913920,
    "text": "that I had it build in the beginning"
  },
  {
    "startMs": 916480,
    "text": "worked."
  },
  {
    "startMs": 918079,
    "text": "Um"
  },
  {
    "startMs": 920160,
    "text": "all right, it's it hasn't built the"
  },
  {
    "startMs": 921760,
    "text": "fluid simulation yet. Uh it's been"
  },
  {
    "startMs": 923839,
    "text": "working for 13 minutes. Um"
  },
  {
    "startMs": 928480,
    "text": "that's actually fine. So basically this"
  },
  {
    "startMs": 929920,
    "text": "is the TL Draw desktop app. Um something"
  },
  {
    "startMs": 932079,
    "text": "that's really cool here is that we have"
  },
  {
    "startMs": 934399,
    "text": "uh so this is running locally. It's"
  },
  {
    "startMs": 935839,
    "text": "working on files. We'll see if it"
  },
  {
    "startMs": 937360,
    "text": "finishes. We'll we'll let this run. Um"
  },
  {
    "startMs": 939920,
    "text": "but basically what this does is this uh"
  },
  {
    "startMs": 942079,
    "text": "this basically exposes the editor"
  },
  {
    "startMs": 943760,
    "text": "instance of the TLR app that's running"
  },
  {
    "startMs": 945440,
    "text": "here. And it has a server that lets any"
  },
  {
    "startMs": 948240,
    "text": "agent uh for example my cloud code uh"
  },
  {
    "startMs": 950720,
    "text": "write just plain JavaScript against the"
  },
  {
    "startMs": 953920,
    "text": "against the editor. and and it it"
  },
  {
    "startMs": 957839,
    "text": "basically it you know it's it's code"
  },
  {
    "startMs": 959279,
    "text": "mode if you've ever used code mode um"
  },
  {
    "startMs": 961279,
    "text": "but you can basically turn your teal"
  },
  {
    "startMs": 963680,
    "text": "desktop app into um a like scripting"
  },
  {
    "startMs": 966880,
    "text": "environment and the one of my colleagues"
  },
  {
    "startMs": 969680,
    "text": "actually is u I'm going to this is this"
  },
  {
    "startMs": 973440,
    "text": "is the kind of off the rails bit of the"
  },
  {
    "startMs": 974959,
    "text": "canvas here um or of the of the talk. So"
  },
  {
    "startMs": 979199,
    "text": "here's something my colleague made uh"
  },
  {
    "startMs": 981279,
    "text": "using the same thing. So this is he has"
  },
  {
    "startMs": 983199,
    "text": "the teal draw desktop app in the corner"
  },
  {
    "startMs": 984800,
    "text": "here and he's using it as his uh window"
  },
  {
    "startMs": 987519,
    "text": "manager. Um and what he did the way he"
  },
  {
    "startMs": 990639,
    "text": "did this was he just told claude code to"
  },
  {
    "startMs": 992399,
    "text": "because cloud code has access to your"
  },
  {
    "startMs": 993920,
    "text": "actual computer. It's not locked into"
  },
  {
    "startMs": 995199,
    "text": "the canvas. Uh it basically you know it"
  },
  {
    "startMs": 997759,
    "text": "it made some rectangles and it uh"
  },
  {
    "startMs": 1000560,
    "text": "probably wrote some Apple script or"
  },
  {
    "startMs": 1001920,
    "text": "something to actually re uh you know"
  },
  {
    "startMs": 1004079,
    "text": "move the things around. And so you can"
  },
  {
    "startMs": 1005279,
    "text": "kind of make all of these uh like"
  },
  {
    "startMs": 1007440,
    "text": "ephemeral UIs and have them actually be"
  },
  {
    "startMs": 1010079,
    "text": "doing things in the real world. Um,"
  },
  {
    "startMs": 1012800,
    "text": "another really cool one that he did was,"
  },
  {
    "startMs": 1015199,
    "text": "um, if this loads, it's Pong on the"
  },
  {
    "startMs": 1018880,
    "text": "desktop. Uh,"
  },
  {
    "startMs": 1021440,
    "text": "let's hit it with a little refresh there"
  },
  {
    "startMs": 1022880,
    "text": "and see if it works. Yeah. So, this is"
  },
  {
    "startMs": 1025679,
    "text": "he's got in the corner here, you know,"
  },
  {
    "startMs": 1027439,
    "text": "you you have uh you have TLR running."
  },
  {
    "startMs": 1030160,
    "text": "This is the desktop app and it's using"
  },
  {
    "startMs": 1032240,
    "text": "the Windows in order to uh play Pong."
  },
  {
    "startMs": 1034959,
    "text": "And so again, like kind of crazy, but"
  },
  {
    "startMs": 1037600,
    "text": "there's uh you know, maybe it seems a"
  },
  {
    "startMs": 1039600,
    "text": "little silly, but"
  },
  {
    "startMs": 1042559,
    "text": "let's see if this this worked. Oh, it's"
  },
  {
    "startMs": 1044640,
    "text": "still working. Man, it was usually much"
  },
  {
    "startMs": 1046000,
    "text": "faster. Um, but I I think this stuff is"
  },
  {
    "startMs": 1049200,
    "text": "so cool because this lets you kind of,"
  },
  {
    "startMs": 1050880,
    "text": "you know, do all of the weird kind of"
  },
  {
    "startMs": 1052960,
    "text": "like spatial interfaces that you can do"
  },
  {
    "startMs": 1055039,
    "text": "uh on the canvas. You get all of like"
  },
  {
    "startMs": 1056640,
    "text": "the primitives of the canvas. Um, but"
  },
  {
    "startMs": 1059440,
    "text": "you can like you can have your agents"
  },
  {
    "startMs": 1060960,
    "text": "working kind of like in the real world."
  },
  {
    "startMs": 1063280,
    "text": "uh it has access to real data. If I"
  },
  {
    "startMs": 1065360,
    "text": "scroll up, I'll show that um"
  },
  {
    "startMs": 1068960,
    "text": "if uh you know this is my cloud code and"
  },
  {
    "startMs": 1072480,
    "text": "it found it it got the Gmail, it got the"
  },
  {
    "startMs": 1075360,
    "text": "notion doc, it found the spec and it's"
  },
  {
    "startMs": 1077039,
    "text": "going to to implement it. Um"
  },
  {
    "startMs": 1080640,
    "text": "but yeah, so to sum up, I think that"
  },
  {
    "startMs": 1083039,
    "text": "agents working on the canvas is so cool"
  },
  {
    "startMs": 1085120,
    "text": "and I think that there's like so much we"
  },
  {
    "startMs": 1086880,
    "text": "can do if we use like the agent the"
  },
  {
    "startMs": 1088960,
    "text": "canvas as a a place to work with agents."
  },
  {
    "startMs": 1091840,
    "text": "And I think the place part of it is"
  },
  {
    "startMs": 1093600,
    "text": "really important because you know when"
  },
  {
    "startMs": 1095200,
    "text": "we do you know with remote work"
  },
  {
    "startMs": 1096799,
    "text": "collaboration we do a lot of stuff"
  },
  {
    "startMs": 1098880,
    "text": "online with each other and we"
  },
  {
    "startMs": 1100320,
    "text": "collaborate with people on the canvas"
  },
  {
    "startMs": 1102320,
    "text": "and I think that the yeah the canvas can"
  },
  {
    "startMs": 1104720,
    "text": "be a place where we uh collaborate with"
  },
  {
    "startMs": 1106400,
    "text": "agents and I'm I'm I'm I'm vamping"
  },
  {
    "startMs": 1108880,
    "text": "because I'm trying to see if this is"
  },
  {
    "startMs": 1110160,
    "text": "finished but I don't think it's going to"
  },
  {
    "startMs": 1111280,
    "text": "finish. Um, but thank you so much"
  },
  {
    "startMs": 1129232,
    "text": ">> [music]"
  }
]