Jediah Katz
Related work and projects
- Cursor agent ↗
Katz works on Cursor’s agent harness. The dynamic-context techniques described in his article are credited to a team of Cursor employees.
cursor.com · Source ↗ - Grok Bot ↗
Katz reports working on Grok Bot and its agent harness.
x.ai · Source ↗ - Dynamic context discovery ↗
Article by Katz describing Cursor’s file-based approach to retrieving context as needed; the implementation is credited to multiple employees.
cursor.com - Continually improving our agent harness ↗
Co-authored with Stefan Heule on evaluation, model-specific harnesses and switching models during a conversation.
cursor.com - Improved token efficiency for longer agent runs ↗
Co-authored with Connor O’Keefe and Calvin Yee on changes that Cursor reports reduced user token costs by 7% without reducing agent quality.
cursor.com - You-Only-Randomize-Once: Shaping Statistical Properties in Constraint-based PCG ↗
A 2024 Foundations of Digital Games paper co-authored with Bahar Bateni and Adam M. Smith on controlling generated output statistics while enforcing constraints.
arxiv.org - you-only-randomize-once ↗
Repository hosted on Katz’s GitHub account containing code for the FDG 2024 paper.
github.com · Source ↗ - Subway Stories ↗
Repository hosted on Katz’s GitHub account for the MTA Open Data Challenge 2024.
github.com · Source ↗
Jediah Katz builds AI coding agents at Anysphere, the company behind Cursor. His work on Cursor’s agent harness—the instructions, tools, and context surrounding a model—focuses on helping agents handle longer tasks while using context efficiently. He also works on Grok Bot, previously worked at Figma, and taught computer science at Penn. His public profile describes those roles.
On this page
Giving agents the context they need
As models have become better at finding information themselves, Katz and his colleagues have moved away from supplying every potentially useful detail at the start of a session. In his account of dynamic context discovery, the agent retrieves information when a task calls for it.
For example, Cursor can save a long tool response to a file instead of truncating it; the agent can then inspect the relevant parts. When a conversation is summarized to make room in the context window, the agent can search the original history for details the summary lost. Cursor also makes descriptions of external Model Context Protocol (MCP) tools available as files, so agents can look them up when needed. MCP tools can give agents access to resources such as production logs, design files, and internal documentation. In an A/B test of runs that called an MCP tool, Cursor reported a 46.9% reduction in total agent tokens, with substantial variation depending on the number of installed MCP servers. Katz credits these techniques to a team of Cursor employees.
Measuring and improving the harness
In work with Stefan Heule, Katz describes combining benchmarks with experiments on real usage. Cursor measures how much agent-generated code remains in a user’s codebase and uses a model to assess whether subsequent user responses suggest satisfaction. Those signals help the team evaluate changes that may look promising in a benchmark but matter less in practice.
The team also adapts prompts and tools to individual models. For example, a model trained to edit files with patches may make more mistakes or spend more reasoning tokens when given an unfamiliar editing format. When users switch models mid-conversation, Cursor changes the harness and adds instructions to help the incoming model interpret a history produced with different tools.
Katz, Connor O’Keefe, and Calvin Yee describe a further set of token-efficiency improvements: shortening system prompts, loading less-used tools on demand, improving cache reuse, and numbering every tenth line in file reads instead of every line. They also reduced prompting that encouraged subagent use and changed the tool arguments so an agent chooses a different model for a subagent only when directed by the user or the harness. Cursor reported that the combined changes reduced user token costs by 7% without reducing agent quality.
Procedural generation research
Katz also co-authored You-Only-Randomize-Once with Bahar Bateni and Adam M. Smith. The 2024 paper addresses a problem in procedural content generation: a designer may want generated outputs to follow both hard constraints and a desired distribution of design elements. The authors use the order in which a constraint solver makes decisions to influence those statistics while still enforcing global constraints, demonstrating the method on generated tile grids.
Read the topics behind these talks
1 conference talk
Loading more talks and highlights…
References
- cursor.com/product ↗
- cursor.com/blog/dynamic-context-discovery ↗
- x.ai/bot ↗
- youtube.com/watch ↗
- cursor.com/blog/continually-improving-agent-harness ↗
- cursor.com/blog/improved-token-efficiency ↗
- arxiv.org/abs/2409.00837 ↗
- github.com/jediahkatz/you-only-randomize-once ↗
- github.com/jediahkatz ↗
- github.com/jediahkatz/subway-stories ↗
