AI Engineer World's Fair 202619:15
The Human Is an Async API — Melanie Warrick, Temporal
Melanie Warrick
Agent engineering · Agent orchestration · Human-in-the-loop validation
← All topics
AI Engineer topic
Human-in-the-loop validation
24 AI Engineer conference talks about Human-in-the-loop validation.
AI Engineer World's Fair 202618:32
The Software Factory: From Bug Report to Production Code — Davis Palmie, Factory
Davis Palmie
Software factory architecture · Developer workflows and testing · Agent readiness
AI Engineer World's Fair 20261:51:26
From Vibes to Production: Evaluating and Shipping AI Agents That Work 101 — Laurie Voss, Arize AI
Laurie Voss
Evals · Agent engineering · Observability and reliability
AI Engineer World's Fair 202615:34
Your AI Agent Has No Nervous System — Matt Gibiec, Dynatrace
Matt Gibiec
Coding agents · Observability and reliability · Developer workflows and testing
AI Engineer World's Fair 202617:46
Why Building an Eval Platform Is Harder Than It Looks — Braintrust
Hossein Niazmandi
Evals · Observability and reliability · Architecture
1:01:28
Lifestyles of the AI-Native — Nick Nisi & Zack Proser, WorkOS
Zack Proser · Nick Nisi
Coding agents · Speech and audio · Agent orchestration
AI Engineer World's Fair 202619:39
From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Jose Palafox
Coding agents · Coding harness · Agent engineering
AI Engineer World's Fair 202624:40
The Death of the Code Review: What the Data Actually Says — Laurie Voss, Arize AI
Laurie Voss
Code review and verification · Coding agents · Evals
AI Engineer World's Fair 20261:07:24
Cooking with Codex — Charlie Guo & Gabriel Chua, OpenAI
Charlie Guo · Gabriel Chua
Coding agents · Agent orchestration · Long-horizon tasks
AI Engineer World's Fair 202659:49
Evals in AI: A Deep Dive — Tejas Kumar, IBM
Tejas Kumar
Evals · Agent engineering · Developer workflows and testing
17:59
The Transcript Looked Fine. The Call Wasn't. — Debugging Voice Agents, Arize
Fuad Ali
Speech and audio · Observability and reliability · Evals
AI Engineer World's Fair 202617:06
The Self-Improving OSS Agent Stack — Marc Klingen, Langfuse
Marc Klingen
Agent engineering · Observability and reliability · Evals
AI Engineer World's Fair 202621:37
From Raw Documents to AI-Ready Data — Leo Platzer & Jeff Koss
Jeff Koss · Leo Platzer
Knowledge curation · RAG, context, and search · Knowledge freshness
AI Engineer World's Fair 202616:38
Giving AI Agents Memory That Learns — Jake Broekhuizen, LangChain
Jake Broekhuizen
Agent engineering · Agent memory · Skill improvement loops
20:47
I Gave an AI a Body — Cyrus Clarke, MIT Media Lab
Cyrus Clarke
AI embodiment · Shape displays · Gesture vocabulary
AI Engineer World's Fair 202617:17
Generation Is Cheap, Review Is Expensive: How to Stop Shipping AI Slop — Gabriel Martinez, G2i
Gabriel Martinez
Engineering judgment · Code review and verification · Code maintainability
21:14
Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase
Miguel González Fernández · Corby Rosset
Evals · Agent engineering · Task-specific rubrics
AI Engineer World's Fair 202619:12
Redesigning How Software Gets Built With AI Agents — Sonar & McKinsey Panel
Tariq Shaukat · Ali-Reza Adl-Tabatabai
Coding agents · Leadership · Developer productivity measurement
AI Engineer World's Fair 202616:49
Brains vs Hands: How to Run AI Agents Safely in Production — Viren Baraiya
Viren Baraiya
Agent engineering · Agent orchestration · Durable execution
AI Engineer World's Fair 202619:06
Move Fast and Don't Break Things: Scaling Databases for the AI Era — PlanetScale
Ben Dicken
Infrastructure and deployment · Observability and reliability · Database sharding
AI Engineer World's Fair 202617:15
Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI
Charles Dickens
Finance · Data and model adaptation · Synthetic data
AI Engineer World's Fair 20261:51:37
Advanced Workshop: Mastering AI Observability — Doug Guthrie, Braintrust
Doug Guthrie
Observability and reliability · Evals · Agent engineering
16:39
Why We Deleted Our MCP Server and Rebuilt It — Abhi Arya, Reducto
Abhi Arya
Agent engineering · APIs, MCP, and protocols · Human-in-the-loop validation
AI Engineer World's Fair 202620:35
Agent Memory Is Solved. Agent Learning Isn't. — Karthik Ranganathan, Yugabyte
Karthik Ranganathan · Heather Downing
Agent engineering · Information and coordination · Knowledge curation