▶ Watch ↗AI Engineer World's Fair 202621:27
Beating RL With Reflection: GEPA and Optimize Anything — Lakshya A. Agrawal, GEPA
Read the full talk →Key ideas
Scroll to read ↓Lakshya A. Agrawal explains how full execution traces can teach an optimizer more than a reward alone—and how the same search can improve prompts, agent programs, repository skills and evaluators.
- Reflection uses the diagnostic content of an attempt—intermediate outputs, tool responses and errors—to propose a behavioral change in text.2:40 ↗
- GEPA’s Pareto pool preserves candidates with strengths on individual examples, allowing search to continue along alternatives when the highest-scoring prompt stops improving.8:51 ↗
- Optimize Anything can search over prompts, programs and policies when they can be represented as text and scored. The evaluator should return actionable feedback alongside its score.10:41 ↗
- Learned repository skills can carry practical knowledge between attempts and models, reducing repeated exploration as well as improving task completion.15:56 ↗
- For subjective tasks, detailed human annotations can first train an LLM judge prompt; that judge can then guide agent optimization in a continuing production feedback cycle.19:18 ↗