Bin Liu

general audience version:

Most agent output still ends its life as text. We think that's a waste of a rendering engine.

This talk shows how treating HTML as an agent's primary output format turns model responses into videos, slide decks, and business artifacts that people can actually use — no bespoke renderer, no proprietary format, just the most widely trained-on markup language in existence.

We'll walk through the architecture of an agentic system built around HTML as its visualization layer, what breaks at scale, and what we learned shipping this in production.

We'll also introduce HyperFrames, our open-source, free framework for agent-generated visuals, and show how teams can drop it into their own agents today.

technical audience version:

Multimodal agents fail in ways text-only agents don't: the model can't see what it made, can't reliably locate things in a frame, and can't hold a long visual edit in working memory.

This talk covers the context engineering techniques we developed at HeyGen to close that gap — asset naming conventions that carry semantics, contact-sheet and collage prompting for VLM review, frame numbering and grid overlays for spatial grounding, and HTML as an intermediate representation that keeps generation inside the model's training distribution.

The underlying thesis: don't fight the distribution, reframe the problem into one the model already knows how to solve. We'll close with HyperFrames, the open-source framework where these techniques live.