AI Engineer Code 2025
Defying Gravity
Read the talk
Defying Gravity: Building an IDE Around Agent Work
Google Antigravity combines an editor, a browser and an Agent Manager to make longer agent tasks easier to direct, inspect and improve.
From a talk by Kevin Hou
Before you start: Familiarity with code editors, pull requests and basic agent tool use will help you follow the examples.
Where do you work when the agent leaves the editor?
If an agent can do more than edit code, where should a developer supervise its work? Google Antigravity begins with that product question. Kevin Hou introduces it during launch week, joking that the arrival of Wicked 2 and Antigravity alongside Gemini 3 Pro has made it a bad week for gravity. Hou, who introduces himself as the product engineering lead, describes the Google DeepMind IDE as the first from a foundational lab. Its central commitment is to put agents first in the developer experience.
The platform has three surfaces: an Editor, a Browser and an Agent Manager. Agents can work across those surfaces instead of remaining inside an IDE sidebar. The Agent Manager is the central hub: one window that lets the developer step back from individual diffs and look at the work being delegated.
The editor remains a familiar VS Code fork, with autocomplete and an agent sidebar mirrored with the Agent Manager. It is where developers can take over when agent-only work is insufficient—what Hou calls getting from eighty percent to one hundred percent of a task. That is a description of the handoff, not a measured completion rate. Hou reports that Command + E or Control + E switches between the editor and Agent Manager in under 100 milliseconds. He gives no measurement setup for that switching latency.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Show the feature working, then ask for attention
Agent-controlled Chrome has two jobs. First, it retrieves context from the web, including authenticated documents and dashboards that the developer grants access to. Hou describes access to Google Docs and GitHub dashboards in terms of the authentication available in normal Chrome. For present-day setup, the browser-profile documentation specifies a separate profile: normal-profile cookies and sign-ins are not shared, but sign-ins made within the agent profile persist. Access to authenticated sites should therefore not be confused with automatic reuse of an existing Chrome session.
Second, the browser lets the agent inspect an application by clicking, scrolling and executing JavaScript. Hou demonstrates a random artwork generator: refreshing the page produces another Thomas Cole picture. After adding a small modal card, the agent supplies a Chrome recording showing the interaction, with a blue circle marking the mouse. The developer can inspect the feature as it appears in the browser, alongside the code changes. The recording is evidence of those interactions, rather than a guarantee that every application behavior is correct.
With the editor and browser serving as agent tools, the Agent Manager becomes a control panel for several tasks. Its inbox collects requests that need intervention, such as approval for a terminal command. OS-level notifications tell the developer when attention is needed, reducing the need to keep checking each conversation.
That launch also exposed an immediate operational limit: capacity. Hou reports that the service ran out and that the team was working through errors. His apology for a global chip shortage is a joke about that pressure; the launch-era changelog separately distinguishes individual quota exhaustion from global capacity limits.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
New model capabilities change the product shape
Why introduce another window? The Agent Manager creates a one-to-many relationship with the other work surfaces. Hou connects that decision to earlier changes in coding tools: short-form completion made Copilot-style autocomplete possible; instruction-following chat shaped by RLHF enabled another interface; agents followed as models became capable of taking actions. A product can only expose the capabilities its models can sustain.
Working inside DeepMind gave the Antigravity team access to Gemini a couple of months early. Product engineers and researchers could explore both directions: which model strengths deserved a new interface, and which gaps prevented the intended experience. Hou groups the changes into four categories, illustrated on his slides with Nano Banana artwork.
| Capability | Product consequence |
|---|---|
| Intelligence and reasoning | More demanding instructions become practical. |
| Nuanced tool use | A browser can expose clicks, navigation and JavaScript execution. |
| Longer-running work | Tasks can continue in the background while the developer does something else. |
| Multimodality | Images and visual outputs become part of the work loop. |
The browser makes tool choice particularly consequential: executing JavaScript is a much broader action space than selecting a simple editor command. Longer thinking also stretches the time between a request and its result. Hou pairs Gemini 3 with Nano Banana Pro as an example of combining reasoning with image capabilities. His proposed next step beyond existing agents is a product hypothesis about how to use these changes together.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Raise the ceiling with context and browser feedback
The first design step is to raise the ceiling of what an agent can accomplish. Specialist research teams make capabilities such as computer use available, but the product still needs to connect them to engineering work. Hou divides that work into deciding what to build, deciding how to build it and actually building it. Code generation increasingly addresses the last part, provided the model has sufficient context and produces functioning code. Human imagination supplies the direction; institutional knowledge helps determine the implementation. Bug dashboards, experiments and other browser-accessible material make that knowledge available to the agent.
The flight-tracker demonstration shows the other half of browser use: verification. A user enters a flight ID and the application returns the flight's start and end. A blue border indicates that the browser is under agent control. Hou says a Gemini computer-use variant performs the interaction, with access to clicking, scrolling and DOM retrieval.
The result includes both a diff and a screen recording. That adds a feedback path: an image-capable model can inspect the visible result and iterate from it. The same browser interaction therefore supplies material for human review and observations for another agent step.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Iterate on the design before writing the website
Software development is already multimodal: developers inspect rendered websites, architecture diagrams, screenshots and recordings. Image understanding helps with verification; image generation adds another way to create and revise the intended result. Antigravity combines Gemini 3 Pro with the image side of the model family rather than treating coding as exclusively a text task.
The mockup demonstration starts in image space. A developer can work toward a website design, attach comments to the image and queue several pieces of feedback before asking the agent to update it. The interaction resembles a GitHub review: collect the comments, submit them together and let the agent decide how to apply them. The displayed plant-site design is the visual object being iterated on before implementation.
Hou describes consecutive launch pushes for Gemini and then the image model, with image generation available in the editor on its launch day. The Antigravity image-model announcement identifies that release as Nano Banana Pro, also called Gemini 3 Pro Image, and specifies an incremental rollout; users without Pro access continued using the original Nano Banana. The product ambition is an editor where new model capabilities can become usable development tools as they arrive.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Artifacts make long tasks reviewable
More capable agents create a second design problem. When tasks take longer, become more complex and cross several surfaces, the user needs a way to understand the work without reading every message. Antigravity calls that interaction primitive an artifact: an agent-generated, dynamic representation of information suited to the user and the task.
Artifacts serve several audiences. They help an agent organize and reflect on its own work; communicate screenshots or recordings to the user; and share information with a browser sub-agent, another conversation or memory. The Agent Manager dedicates roughly half its screen, plus sidebar space, to these objects.
Chunking the conversation makes a long run somewhat easier to follow, but it still leaves the developer scrolling through strings and tokens to discover what happened. A visual representation can communicate the relevant structure more directly. Hou uses his own PowerPoint as the analogy: the slides are his artifact, making a spoken explanation easier to follow. The underlying agent conversation remains available, but it no longer has to carry the entire burden of review.
Dynamic means that the agent chooses whether an artifact is useful and what form it should take. A title change may not need one. For a larger task, the lifecycle can look like this:
- Research and plan. Produce a Markdown implementation plan resembling a product requirements document, including open questions. Hou's example surfaces three questions before work begins.
- Decide whether to continue. If there are no unresolved questions, the model may proceed automatically. An underspecified request or a discovery during refactoring can instead require clarification.
- Track execution. After approval where needed, use a task list to expose progress and architecture diagrams to explain structure.
- Present the result. Finish with a walkthrough resembling a pull-request description: explain what changed and provide evidence that it works.
Images, screen recordings and Mermaid diagrams are other possible representations. Hou expects the set to expand as agents discover useful ways to present information.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Keep discoveries that the next task will need
An artifact also needs a purpose and an audience. Why was it created? Should a sub-agent see it? Should it be available to another conversation or stored in memory? Hou illustrates those choices with API research: give the agent documentation and an API key, and it can issue curl requests to investigate response schemas and types, then produce a report.
For an API that uses bearer authentication, a minimal inspection request can take this form, with API_URL set to a documented read endpoint:
bash
curl --fail-with-body --silent --show-error \
--header "Authorization: Bearer ${API_KEY}" \
--header "Accept: application/json" \
"${API_URL}"
The returned response is an observation for the research report; one request does not establish every possible response shape. The reusable artifact is the accumulated understanding of the API, not merely the command used to inspect it.
Hou's example preserves that report in memory so the next task does not have to repeat the same investigation. If the research instead produces an open question, a proactive notification brings it back to the user. Artifacts can therefore carry knowledge forward as well as request the attention needed to continue.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Steer running work through the artifact
Review is not confined to the beginning or end of a task. Antigravity borrows from Google Docs and GitHub: highlight text, attach comments, batch them and send them together. A comment can clarify an incomplete part of a plan or change an implementation choice—for example, asking the agent to use vanilla CSS instead of Tailwind.
Images use a Figma-like selection pattern: select a region and leave feedback on that part of the design. Hou says the agent is instrumented to incorporate these comments without interrupting its task execution loop. A user can object to a result while browser interaction is underway, submit the comment and receive a notification after it has been addressed. Submitting feedback is a request for a change; incorporation happens subsequently.
That interaction supports parallel work. The Agent Manager can coordinate different projects, or separate activities within one project: design mockup iteration, API research and application implementation. Artifacts are where the developer reviews and directs each activity; notifications indicate which one needs attention.
Direct control remains available when the model is not capable enough or the developer does not trust a particular task to it. Command + E opens the editor with the exact files, artifacts and conversation associated with the work. Autocomplete and synchronous chat let the developer finish from there. Hou expects more time to shift toward the Agent Manager and parallel sub-agents as capabilities improve, but the editor remains an intentional escape hatch.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Improve the model and the harness together
The third part of the design is organizational: use the product heavily enough to discover what needs to improve. Drawing on roughly three years in code generation, Hou describes internal use as the basis for a research–product feedback loop. Google engineers and DeepMind researchers received early access and then official internal access, putting the people improving the models in contact with the Agent Manager and its artifacts.
That experience gives different teams concrete problems to work on. An infrastructure engineer encounters slow responses; a computer-use researcher sees a failed button click, poor scrolling or difficulty locating text. Image generation and instruction-following teams also encounter their capabilities within the complete application. Hou argues that this exposes gaps evaluations alone miss. His prediction of market leadership rests on this internal use, alongside a commitment to bring frontier capabilities to external users through the same product.
The computer-use collaboration illustrates why the loop has to run in both directions. Nearby researchers and product engineers can investigate whether a failure comes from a model capability gap or a mismatch in data distribution. They can also discover that the agent harness exposes faulty tools. In the latter case, the product team has to repair its side of the interaction. Calling a model API is only one part of making the full system work.
Artifacts supplied a second example. Hou reports that early model versions handled them poorly: the new review interaction did not fit familiar training patterns. Product plumbing and collaboration with researchers created a concrete target for improvement, leading to better artifact handling by the Gemini 3 Pro launch. The product introduced a new behavior to support; research and engineering then worked together to make it dependable enough to expose.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Build for a higher capability ceiling
The ambition includes vibe coding, and Hou acknowledges AI Studio as another strong Google product. Antigravity's emphasis is on increasing the ceiling: enabling more demanding agent work, making it manageable through artifacts and the Agent Manager, and using the research–product loop to improve what the system can actually accomplish. These are connected design choices. Greater capability creates harder supervision problems; a new interaction pattern creates new demands on the model.
The closing returns to the realities of shipping. Hou jokes that users can adopt a TPU to help quiet PagerDuty, invites feedback on Twitter—preferably through DMs—and welcomes reports from people using the released product. The next round of improvement depends on that contact with real work, including the operational pressure it creates.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Resources
From the talk
The original launch explanation of Antigravity's agent-first development platform and artifact-based collaboration.
How image generation supports UI mockups, visual design feedback, architecture diagrams and application assets.
Further reading
Launch-era examples of asynchronous agent work, browser verification, artifact feedback and reusable knowledge.
Updates since the talk
Explains browser-profile isolation, persistent sign-ins and profile-location settings.
Read the complete timestamped transcript
- 0:12
[upbeat electronic music] [audience applauding] All right, hello. Last one of the day. Can we get a, uh, little energy boost? Who's ready? [audience cheering] Who's ready? [audience applauding]
- 0:29
All right, happy Friday. I hope everyone has had a good week, a good conference. Um, and let me tell you, it's been a really bad week if you are gravity.
- 0:37
Wicked 2 is coming out tonight, and then of course, Antigravity came out earlier this week alongside Gemini 3 Pro on Tuesday.
- 0:46
Google Antigravity is a brand-new IDE out of Google DeepMind. It's the first one from a foundational lab, and it is coming right off the press. In fact, um, I probably should be working on the product right now, but I wanted to spend some time to share what we've built here today.
- 1:04
Antigravity is unapologetically agent first, and today I'm gonna tell you a little bit about what that means and how it manifests in the product. But perhaps maybe a little bit more interestingly, we're gonna talk a little bit about how we got here, product principles, direction of the industry, these sorts of things.
- 1:20
Um, so my name is Kevin Hou. I lead our product engineering team at Google Antigravity.
- 1:26
And let's start with the basics. Um, and first, just to get a sense of the room, um, who has used Antigravity?
- 1:33
All right, there you go. Power of Google. Love it.
- 1:36
Um, who's used the Agent Manager? Cool. Nice. Good. Good. All right. So basics of Antigravity.
- 1:45
Antigravity, notably Antegravity, not Antigravity, Antegravity, it's an AI developer platform with three surfaces. The first one is an editor, the second one is a browser, and the third one is the Agent Manager.
- 1:58
So we'll dive into what this means, which one-- what, what each looks like. So a paradigm shift here is that agents are now living outside of your IDE, and they can interact across many different surfaces that your agent or that you as a software developer might spend time in.
- 2:14
And let's start with the Agent Manager, so that's the thing up top. This is your central hub. It's an agent-first view, and it pulls you one level higher than just looking at your code.
- 2:23
So instead of looking at diffs, you'll be kind of a little bit further back. And at any given time, there is one Agent Manager window.
- 2:32
Now, you have an AI editor. This is probably what you've grown to love and expect. Has all the bells and whistles that you would expect. Uh, lightning-fast autocomplete. This is the part where you can make your memes about, "Yes, we forked VS Code."
- 2:45
And it has an agent sidebar, and this is the sort of thing. It's mirrored with the Agent Manager, and this is when you need to dive into your editor to accomplish maybe your eighty percent to a hundred percent of your task.
- 2:55
And at any point, we made it very, very easy because we recognize not everything can be done purely with an agent,
- 3:00
for you to Command + E or Control + E and hop instantly from the editor into the Agent Manager and vice versa, and this takes un- under a hundred milliseconds.
- 3:10
It's zippy. And then finally, something that I love, an agent-controlled browser. This is really, really cool, and hopefully for the folks in the room that have tried Antigravity, you've noticed some of the magic that we've put in behind here.
- 3:22
So we have an agent-controlled Chrome browser, and this gives the agent access to the richness of the web, and I mean that in two ways. The first one, context retrieval, right?
- 3:32
It has the same authentication that you would in your normal Chrome. You can give it access to your Google Docs. You can give it access to, you know, your GitHub dashboards and things like that and interact with a browser like you would as an engineer.
- 3:43
But also, what you're seeing on the screen is that it lets you-- it lets the agent take control of your browser, click and scroll and run JavaScript and do all the things that you would do to test your apps.
- 3:53
So here I put together this, like, random artwork generator. All you do is refresh, and you get a new picture of, um, like a Thomas-- piece of Thomas Cole artwork.
- 4:02
And now we added in a new feature, which is this little, little modal card, and the agent actually went out and said, "Okay, I, I made all the code, but instead of showing you a diff of what I did, let's instead show you a recording of Chrome."
- 4:14
So this is a recording of Chrome where the blue circle is the mouse. It's moving around the screen, and this way, you get verifiable results. So that's what we're very excited about our, uh, our, our Chrome browser.
- 4:25
And then the Agent Manager can serve as your control panel. The editor and the browser are tools for your agent, and we want you to spend time in the Agent Manager.
- 4:34
And as models get better and better, I bet you you're gonna be spending more and more time inside of this Agent Manager. And it has an inbox, and I'll talk a little bit about this and sort of why we did this, but it lets you manage many agents at once.
- 4:47
So you can have things that require your attention. For example, running terminal commands. We don't want it to just kind of go off and just run every terminal command.
- 4:54
There are probably some commands that you wanna make sure you, you hit okay on. So things like this will get surfaced inside of this inbox. One click, you can manage many different things happening at once.
- 5:03
And it has a wonderful OS-level notification, so if there is something that you need, it will sort of let you know, and this kind of solves that problem of multithreading across many tasks at once.
- 5:14
And so our team is thrilled to launch this brand-new product. It's a brand-new product paradigm, and we did so in conjunction with Gemini 3, which was a very exciting week for the team.
- 5:23
But alas, we ran out of capacity. [audience laughing] Um, this has been tormenting me the last couple of days [chuckles], and so I apologize. On behalf of the Antigravity team, I'd like to apologize for our global chip shortage.
- 5:35
Um, we're working around the clock to try and make this work for you. Uh, hopefully we'll have a few less of these sorts of errors. Um, but we've-- What's been really exciting is people who have used the product have seen what the magic of combining these three surfaces can do for your workflows, for your software development.
- 5:49
Um, so let's talk about it. Why did we build the product? How did we arrive at this sort of conclusion? You might say, "Oh, adding in a new window, it's pretty, pretty random," right?
- 5:59
It's this one-to-many relationship between the Agent Manager and many other surfaces.
- 6:04
Um, and it's important to remember, I, I've been at this conference a couple of times, and, and everything, every single time there is this theme: the product is only ever as good as the models that power it.
- 6:14
And this is very important for us as builders, right? Every year there is this sort of new step function. The first, there was a year when it was autocomplete, right?
- 6:22
Copilot, and this, this sort of thing was only enabled because models suddenly got good at doing the short form autocomplete. And then we had chat, we had chat with [REDACTED:username], then we had agents.
- 6:32
So you can see how every single one of these product paradigms is sort of motivated by some change that happens with model capabilities. And it's a blessing that our team is able to work and be embedded inside of DeepMind.
- 6:43
We had access to Gemini for a couple of months, um, earlier, and we were able to work with the research team to basically figure out, you know, what are the strengths that we wanna show off in our product?
- 6:51
What are the things that we can exploit? And then also, what are the gaps, right? This desired experience. Where are the gaps in the model and, and how can we fix that, right?
- 7:00
And so this is, this was a very, very powerful part of why Antigravity came to be. And there are four main categories of improvements powered by a little NanoBanana artwork.
- 7:10
The first one is intelligence and reasoning. You all are probably familiar with this. You used Nano-- Or you used, um, uh, Gemini 3, and you probably thought it was a smarter model.
- 7:17
This is good. It's better at instruction following. It's better at using tools. There's more nuance in the tool use. You can afford things like, you know, there's a browser now.
- 7:25
There's a million things that you could do in a browser. It can literally even j-- execute JavaScript. How do you get an agent to understand the nuance of all these tools?
- 7:32
It can do longer running tasks. These things now take a bit longer, right? And so you can afford to run these things in the background. It thinks for longer.
- 7:40
Just time, time has gotten stretched out. And then multimodal. I really love this property of what Google has been up to. The multimodal functionality of Gemini 3 is off the charts, and you start combining it with all these other models like NanoBanana Pro, um, and you really get something magical.
- 7:56
So we have these roughly four different categories where things have gotten much better.
- 8:01
And if you think about these properties, the question becomes, what do we do about these differences? And from a product perspective, it's like, how do you construct a product that can take advantage of this new wave?
- 8:11
And hopefully, and in my opinion, this is the next step function, autocomplete, chat, agents, and then I probably gotta come up with something more interesting than whatever this thing is called. [chuckles]
- 8:22
So step one is we want to raise the ceiling of capability. We want to aim higher, have higher ambition.
- 8:30
And so a lot of the teams at DeepMind were working on all sorts of cutting-edge research, right? There's-- Google is a big com-- big, big company, and one of my learnings going from a startup to one of these bigger companies is that there is a team of people that is attacking a very, very hard technical problem.
- 8:45
And as a nerd, this is super exciting, right? And then as a product person, it's like, wow, we can start using computer use. So browser use has been one of these huge unlocks.
- 8:57
And this is twofold, right? I mentioned the sort of retrieval aspect of things. Um,
- 9:04
I guess for, for software engineers, there is much more that happens that is beyond the code, right? You can roughly think about it as there's what to build, there's how to build it, and then you actually have to build it.
- 9:13
I would say building it has become more or less, you know, it's reasonable for the model to now, given context, it can generate the code that hopefully functionally works.
- 9:21
And then you've got the what to build. This is the part that is up to you, kind of human imagination. And then there's the how to build it, right?
- 9:27
And there's this richness in context, the richness in institutional knowledge, and these are the sorts of things that having access to a browser, having access to your bug dashboards, having access to your experiments, all these sorts of things that now gives the agent this additional level of context.
- 9:41
And maybe I should've clicked before, but if you saw on the screen... Let's see, how do I do this?
- 9:47
So this is now the other side of things, browser as verification. So you might have seen this video. This is a tutorial video that we put together on just how to use it.
- 9:53
But this is the agent. The blue border indicates that it's being in control by the agent. And so this is a flight tracker. You put in, you know, a, a flight ID, and then it'll give you sort of the start and end of, of that flight.
- 10:04
And this is being done entirely by a Gemini computer use variant. And so it can click, it can scroll, it can retrieve the DOM, it can do all the things.
- 10:12
And then what's really cool is you end up with not just a diff, you end up with a screen recording of what it did. So it's changed the game, and the model can take this, and because it has a, the ability to understand images, it can take this and iterate from there.
- 10:26
So that was the first category, browser use. Just an insane, insane magical experience. Now, the second place that we wanted to spend time is on image generation. And we noticed this theme when we, you know, when I, when I first started at, at Google, we noticed, okay, Gemini is spending a lot of time on multimodal.
- 10:40
And this is really great for consumer use cases, right? NanoBanana 2 was, was mind-boggling. Um, but also for devs. Devs are inherently-- This is a multimodal experience. You're not just looking at text.
- 10:51
You're looking at the output of websites. You're looking at architecture diagrams. There's so much more to coding than just text. And so there's image understanding. This is verifying screenshots, verifying recordings, all these sorts of things.
- 11:05
And then the beautiful part about Google is that you have this synergistic nature. This product takes into account not just Gemini 3 Pro, but also takes into account the image side of things.
- 11:14
And so here I wanna give you a quick demo of, um, mock-ups. So I have a hunch, and you all probably believe this too, design is gonna change, right?
- 11:23
You're gonna spend, you know, maybe some time iterating with an agent to, to arrive at a mock-up. But for something like, "Oh, let's build this website," we can start in image space.
- 11:32
And what's really cool about image space is it lets you do really cool things like this. We can add comments. And so you end up commenting and leaving a bunch of, a bunch of queued-up responses, and it's kinda like GitHub.
- 11:42
You'll just say, "All right, now update the design." And then it'll put it in here. The agent is smart enough to know when and how to apply those comments.
- 11:49
And now we're iterating with the agent in image space. So really, really cool new capability. And what was awesome is that, um, we had NanoBanana Pro, you know, we pulled an all-nighter for, uh, for the Gemini launch 'cause that was our first launch.
- 12:02
Then they said, "Do it again. Do it on Thursday." So we made Gemini Pro, um... Or I'm getting all these model names confused.
- 12:09
The image gen one, the nano banana one, we made that available on day one. I'm running on very little sleep [laughs] on day one inside of the Antigravity Editor. And our hope is that the Antigravity Editor is this place where any sort of new capability can be represented inside of our product.
- 12:24
And so step two was, all right, we have this new capability. We've pushed the ceiling higher. Agents can do longer running tasks. They can do more complicated things. They can interact on other surfaces.
- 12:34
And so this necessitates a new interaction pattern, and we're calling this Artifacts.
- 12:40
This is a new way to work with an agent, and this is one of my favorite parts about the product, and at its core is this Agent Manager.
- 12:49
So let's start by defining an artifact. An artifact is a dynamic representation of something that the agent generates. Sorry, it's a-- An artifact is something that the agent generates that is a dynamic representation of information for you and your use case, and the key here is that it's dynamic.
- 13:07
Artifacts are used to keep the agent organized. They can use-used for, uh, kind of like self-reflection and, and, and self-organization. It can be used to communicate with the user to maybe give you a screenshot, to maybe give you a screen recording like we described.
- 13:20
And it can also be used across agents, whether this be with our browser sub-agent or with other conversations or as memory. And this is what you see on the right side of this Agent Manager.
- 13:31
We've dedicated sort of half the screen and, and your sidebar to this concept of artifacts.
- 13:40
And so we've all tried to follow along chain of thought, and I would say this, you know, we did some fanciness here inside of the Agent Manager to make sure conversations are broken up into, like, chunks.
- 13:49
So in theory, you could follow along a little bit better in the conversation view, but ultimately you're looking at a lot, a lot of strings, a lot of tokens.
- 13:55
This is, like, very hard to follow. And then th-this is actually, like, there's like ten of these, right? So you just scroll and scroll and scroll, and you're like, "What the heck did this agent do?"
- 14:03
And, and this, this has been traditionally the way that people review and sort of supervise agents. They're kind of just looking at the thought patterns.
- 14:12
But isn't it much easier to understand what is going on inside of this visual representation? And that is what an artifact is. The whole point, and the reason why I'm not just standing up here and giving you this long, you know, stream of consciousness, is because I have a PowerPoint.
- 14:24
The PowerPoint is my artifact. And so Gemini 3 i-is really, really strong with this sort of visual representation. It's really strong with multimodal. And so instead of showing this, which of course we always let you show, we alway- we will always show you this, but we wanna focus on this, and I think this is the game-changing part
- 14:41
about Antigravity. And the theme is this dynamicism. The model can decide if it wants to generate an artifact. And let's remember there are some tasks, we're changing a title, we're changing something small, it doesn't really need to, to produce an artifact for this.
- 14:56
So it will decide if it needs an artifact. And then second, what type of artifact? And this is where it's really cool. There, there are many potential in- potentially infinite ways that it can represent information.
- 15:07
And so the common ones are marked down in the concept of a, of a plan and a walkthrough. So this is probably what you've used most, most often. When you start a task, it will do some research.
- 15:17
It will put together a plan. This is much-- very similar to like a PRD. It will even list out open questions. So you can see in this feedback section it'll surface, "Hey, you should probably answer these three questions before I get going."
- 15:27
And what's really awesome, and we're betting on the models here, what's really awesome is that the model will decide whether or not it can auto-continue. If it has no questions, why should it wait?
- 15:35
It should just go off. But more often than not, there are probably areas where you may be under-specified or maybe it did something during research, right? Everyone has gone through and, and started a big refactor, then realized they actually don't have all the information ahead of them.
- 15:46
They gotta go back to the drawing board, maybe talk to some people. Same idea. So it'll surface, um, it'll surface open questions for you, and so that's-- you'll start with that implementation plan, and then you'll say, "All right, LGTM.
- 15:57
Let's, like, send it." You'll go all the way down. It might produce other artifacts. You know, we've got a task list here. This is the way that you can monitor the, the progress of the agent instead of looking at the conversation.
- 16:08
Might put together some architecture diagrams, and then you'll get a, you'll get a walkthrough at the end, and this walkthrough, you kind of saw a glimpse of this before, but it is, "Hey, how do I prove to you, agent to human, that I did the correct thing and I did it well?"
- 16:21
And then this is the part that you'll end with. It's kind of like a PR description. And then there's a whole host of other types, right? Images, screen recordings, these mermaid diagrams.
- 16:30
And really, what's, what's, what's quite cool is that because it's dynamic, the agent will decide this over time. So suddenly there's maybe a new type of artifact that we maybe we missed, right?
- 16:38
And then it'll figure that out. It'll just become part of the experience. So it's very scalable. But this artifact primitive is something that's very, very powerful that I'm pretty excited about.
- 16:48
And then I guess another question is why is it needed? So we'll always explain to the user what the purpose of this artifact is. Um, and then interestingly, like, who should see it?
- 16:58
So should the sub-agent see it? Should the other agents see it? Should other conversations see this? Should this be stored in my memory bank? Right? If this is something that I derived, one of the cool examples, um, that I like is, like, if you give it a, a piece of documentation and you have your API key, it'll,
- 17:12
like, go off and run curl requests to basically figure out the exact schema of, like, what the types of APIs you're using. And it'll do this, like, deep research, um, for quite a while, and then it'll give you a report and basically, like, deeply understand, uh, this sort of, uh, this sort of API.
- 17:27
You wouldn't wanna just throw that away and have to rederive it the second time you did this. So it'll store it in your memory, and then all of a sudden, that's just a part of your knowledge base.
- 17:34
So and then there's also this idea of, like, notifications, right? So if there's an open question, you want the agent to be proactive with you. And that's another very cool property of this artifact system.
- 17:45
We wanna be able to provide feedback along this cycle. So from task start to task end, we wanna be able to provide feedback and inform the agent on what to change.
- 17:56
And the artifact system lets you iterate with the model more fluidly during this process of execution. And so not to sound like a complete Google shill, but I love Google Docs, right?
- 18:07
Google Docs is a great pattern. It's awesome. The comments are great, and this is how you might interact with a colleague, right? You're collaborating on a document, then all of a sudden you wanna leave a text-based comment.
- 18:16
So we took inspiration from that, we took inspiration from GitHub. But you leave comments, you highlight text, you say, "Hey, maybe this part needs to get ironed out a bit more.
- 18:23
Maybe there's a part that you missed, or actually don't use Tailwind, use vanilla CSS." So these are the sorts of comments that you would leave. You'd batch them up, and then you'd go off and send.
- 18:31
And then in image space, this is very cool, we now have this like Figma style, drag and drop like... or not drag, you know, highlight to select. And now you're leaving comments in a, in a completely different modality, right?
- 18:42
And we've done this and instrumented the agent to na- naturally take your comments into consideration without interrupting that task execution loop. So at any point during your conversation, you could just say, "Oh, actually, you know, mid, mid-browser actuation, I actually really don't like the way that that turned out."
- 18:57
Let me just highlight that tell you, u- uh, send it off, and then I'll just get notified when you're done taking into consideration those comments. And so it's a whole new way of working, and this is really at the center of what we're trying to build with Antigravity.
- 19:10
It's pulling you out into this higher level view. And the Agent Manager really is built to optimize the UI of artifacts. So we have a beautiful, beautiful artifact review system.
- 19:24
We're very proud of this. And it can also handle sort of the property that is like parallelism and orchestration. So whether this be many different projects, whether this be the same project and you just wanna execute maybe a design mockup iteration at the same time you're doing research on an API, at the same time you're iterating and,
- 19:43
and, and actually building out your app, you can do all these things in parallel. And the artifacts are the way that you provide that feedback, the notifications are the way that you know that something requires your attention.
- 19:52
It's a completely different pattern. And what's really nice is that you can, you can take a step back, and of course, you can always go into the editor. I'm not gonna lie to you, there are tasks that, you know, you maybe don't trust the agent yet, you don't trust the models yet.
- 20:03
And so you can Command + E, and you can Command + E, and it'll open inside the editor within a split second with the exact files, the exact artifacts, and that exact conversation open, ready for you to autocomplete away, to continue chatting synchronously, to get you from eighty percent to a hundred percent.
- 20:18
So we always wanna give devs that escape hatch. But in the future world, we're building for the future, you'll spend a lot of time in this Agent Manager working with parallel sub-agents, right?
- 20:27
It's a very, very exciting concept. Okay, so now that you've seen we've got new capabilities, multitude of new capabilities, we've got a new form factor. Now the question is like, what is going on under the hood at DeepMind?
- 20:42
And the secret here is a lesson that I guess we've just learned over the past, I don't know, we've spent like, or I, I've personally spent like three years in, in codegen, is just to be your, your biggest user, right?
- 20:54
And that creates this research and product flywheel.
- 20:58
And so I will tell you, Antigravity will be the most advanced product on the market because we are building it for ourselves. We are our own users. And so in the day-to-day,
- 21:08
we were able to give Google engineers, DeepMind researchers, we were able to give them an early access, and now an official access, to Antigravity internally. And so now all of a sudden, the actual experience of the models that people are improving, the actual experience of, of using the Agent Manager and touching artifacts, is letting them see at
- 21:29
a very, very real level, what are the gaps in the model?
- 21:34
And whether it be computer use, whether it be image generation, whether it be instruction following, right? Every single one of these teams, and there are many teams at Google, has some hand inside of this very, very full stack product.
- 21:50
And so you might notice as an infrastructure engineer, you might say, "Oh, this is a bit slow." Well, build it for yourself. Make it faster. Image gen, all of a sudden computer use isn't going well.
- 21:59
It can't click this button. It's really bad at, at scrolling, really bad at finding text on the page. Well, go off and, and make that better, right? So it gives you this level of insight that evals just simply can't give you.
- 22:09
And I think that's what's really cool about being at DeepMind. You are able to integrate product and research in a way that creates this flywheel and pushes that frontier.
- 22:17
And I guarantee you that whatever that frontier provides, we will provide in Antigravity for the rest of the world. These are the same product. And so I'll give you two examples of how this is, has worked.
- 22:27
The first one was that computer use example, right?
- 22:30
In collaboration with the computer use team, which we sit, you know, a couple, couple tens of feet away from, we identified gaps on both sides, right? So we're not just using an API, we are interacting across teams to basically say, "Oh, like the capability is kind of off here.
- 22:45
Can, can we go off and figure out what's going on here? Maybe there's a, there's a mismatch in data distribution." And then on the other side, it's like, "Yo, your like agent harness is like pretty screwed up.
- 22:54
You gotta fix your tools," right? And so then we'll go off and we'll fix our side. But it's this harmony, it's, it's both sides talking to each other that really makes this type of thing possible.
- 23:02
Similarly, you come up with a new product paradigm, artifacts. Artifacts were not good on the initial, on the initial, uh, versions, right? What part of training, what part of data distribution includes this like weird concept of reviews?
- 23:16
And so it took a little bit of plumbing, a little bit of work with the research team to figure out, all right, let's steadily improve this ability. Let's give you a hill to climb.
- 23:24
And then now we were able to launch Gemini 3 Pro with a very good ability to handle these sorts of artifacts. And so it's this cyclic nature that I'm really, really betting on.
- 23:34
And this, this is really how Antigravity will defy gravity. We've got pushing the ceiling. We're gonna have an agent with very, very high level of ambition. We're gonna try and do as much as we can.
- 23:45
And this includes vibe coding, though I will say there are some excellent products out there by Google. AI Studio is an excellent product.
- 23:53
We are in the business of increasing the ceiling.
- 23:58
Second, we built this agent-first experience, Artifacts, Agent Manager. And then finally, we have this research product flywheel. And this is the magic, and this is the three-step process that we used in building Antigravity.
- 24:13
So it's been a blast. I mean, I've, I've been back at, um, AI Engineer Summit. Thank you again, Swix and Ben, for having me. It's been awesome to come back every year.
- 24:21
And so on behalf of the Antigravity team, I just wanna thank you for your time, for your patience as you use the product, um, and your support. And of course- [laughing]
- 24:30
You too can adopt a TPU and help us, uh, turn off PagerDuty a bit more. Um, and then of course, you know, you could also yell at me on Twitter.
- 24:38
That's another way of doing it. Maybe do it in DMs instead. Um, but we've got a lot of exciting things, and I'm really, really excited to bring Antigravity to market.
- 24:44
The team is thrilled that this is now out in the wild, so we welcome your feedback. Um, and thank you again for listening. Enjoy the rest of the conference. [clapping] [upbeat music]