▶ Watch ↗AI Engineer World's Fair 20267:30
Autoresearch Made Our Models 3x Faster — Tejas Bhakta, Morph
Read the full talk →Key ideas
Scroll to read ↓Tejas Bhakta of Morph explains how human optimization ideas, agent-tuned GPU kernels, and bare-metal changes combine—and why a faster kernel can still make inference slower.
- Autoresearch makes kernel tuning a repeated propose, check, benchmark, and keep-or-revert loop. Humans still supply the larger optimization idea.0:49 ↗
- Give the agent both target-hardware information and the model’s actual operations; otherwise it can search an implementation that the hardware cannot support or the model cannot use.3:20 ↗
- Judge improvements in their inference workload. Disabling CUDA graphs or testing only short contexts can make a local kernel win misleading, and a useful kernel may need a limited operating range.4:27 ↗
- The reported 3x result combines kernel and hardware improvements. Expect many rejected attempts: Bhakta estimates roughly 80% are bad.6:31 ↗