← All speakers

Bio, Work & Ideas

Tejas Bhakta

Conference affiliation: CEO · Morph · 2026

Tejas Bhakta was introduced in his 2026 AI Engineer World’s Fair biography as the founder and CEO of Morph, building specialized models and specialized inference for code generation. He previously worked as a machine learning engineer at Tesla, where he worked on inference optimization for Tesla AI.

In his presentation, Bhakta describes how his team uses autoresearch to optimize custom GPU kernels, including for lower-cost GPUs without NVLink. Humans identify optimization opportunities, while agents tune block sizes and other parameters through repeated correctness checks, performance benchmarks, and decisions to keep or revert changes. His approach gives agents context about the specific hardware and model architecture and evaluates end-to-end inference performance to catch misleading improvements, such as a faster isolated kernel achieved by disabling CUDA graphs. He reports a combined threefold speedup from kernel and hardware optimizations, with bare-metal tuning contributing roughly 25% over a virtualized setup, while emphasizing that custom kernels have workload-specific limits and roughly 80% of autoresearch attempts are unsuccessful.

1 conference talk

Key ideas

Scroll to read ↓

Tejas Bhakta of Morph explains how human optimization ideas, agent-tuned GPU kernels, and bare-metal changes combine—and why a faster kernel can still make inference slower.

  • Autoresearch makes kernel tuning a repeated propose, check, benchmark, and keep-or-revert loop. Humans still supply the larger optimization idea.
    0:49 ↗
  • Give the agent both target-hardware information and the model’s actual operations; otherwise it can search an implementation that the hardware cannot support or the model cannot use.
    3:20 ↗
  • Judge improvements in their inference workload. Disabling CUDA graphs or testing only short contexts can make a local kernel win misleading, and a useful kernel may need a limited operating range.
    4:27 ↗
  • The reported 3x result combines kernel and hardware improvements. Expect many rejected attempts: Bhakta estimates roughly 80% are bad.
    6:31 ↗

References