AI Engineer World's Fair 202619:15
The Human Is an Async API — Melanie Warrick, Temporal
Melanie Warrick
Agent engineering · Agent orchestration · Human-in-the-loop validation
← All topics
AI Engineer topic
Human-in-the-loop validation
Talks 1–48 of 86 AI Engineer conference talks about Human-in-the-loop validation.
17:32
How to Know When an AI Agent Can Work Unsupervised — Evan Kormos, Coinbase
Evan Kormos
Agent engineering · Workflow automation · Evals
44:30
Insurance Claims Are AI's Messiest Data Problem — Denys Linkov, Wisedocs
Denys Linkov
Enterprise AI · AI in healthcare · Data quality & curation
16:29
The Investor's Edge Lives in Their Head — Anekha Sokhal, Moshi
Anekha Sokhal
AI in finance · Human-in-the-loop validation · Context engineering
15:30
A Bank Built Its Own Coding Agent. It Took Off — Felippe Felisola Caso & Francesco Galletta, Monzo
Felippe Felisola Caso · Francesco Galletta
Coding agents · AI platform engineering · MCP
18:42
One Day, $1,000 in Tokens: An AI War Room for Legacy Code — Ford Prior, GEICO
Ford Prior
Coding agents · Agent orchestration · Enterprise AI
AI Engineer World's Fair 202618:32
The Software Factory: From Bug Report to Production Code — Davis Palmie, Factory
Davis Palmie
Software factories · Developer workflows & testing · Agent engineering
AI Engineer NYC 2026 Online Talks10:02
The Cost of Accessibility in AI — Jemima Abu, CAIS
Jemima Abu
Human & agent accessibility · Coding agents · Agent skills
AI Engineer World's Fair 202634:13
Parameter Golf with AutoResearch — Vayum Arora, Zhengyao Jiang, Dixing Xu & Dhruv Srikanth, Weco AI
Vayum Arora · Zhengyao Jiang · Dixing Xu · Dhruv Srikanth
Autoresearch · Evals · Observability & reliability
AI Engineer World's Fair 202647:37
Hiring Employable Agents + Startup Battlefield Finals — Howie Liu, HyperAgent
Howie Liu · Shawn "swyx" Wang · Joshua Xu
Agent engineering · Workflow automation · Agent orchestration
AI Engineer World's Fair 202621:14
AI in GTM at Notion — Flora Liu
Flora Liu
AI in sales & marketing · Workflow automation · Human-in-the-loop validation
AI Engineer NYC 2026 Online Talks6:28
What Technical Due Diligence Finds When the Deck Says “70% Automated” — Soukaïna Abelhad
Soukaïna Abelhad
Product engineering · AI engineering leadership · Developer productivity
20:49
Every step you take, every call you make: the reliable agent stack — Giselle van Dongen, Restate
Giselle van Dongen
Infrastructure & deployment · Observability & reliability · Human-in-the-loop validation
20:02
1,368 AI Failures and What They Teach About Evals — Vishal Srivastava, New York Life & Tanmay Sah
Vishal Srivastava · Tanmay Sah
Evals · Safety & governance · Observability & reliability
18:57
AI Agents Cut 3-Day Portfolio Builds to Minutes — Jack McDonald, Apollo & Michael Manapat, Rowspace
Michael Manapat · Jack McDonald
AI in finance · Enterprise AI · Workflow automation
AI Engineer World's Fair 20261:51:26
From Vibes to Production: Evaluating and Shipping AI Agents That Work 101 — Laurie Voss, Arize AI
Laurie Voss
Evals · Agent engineering · Observability & reliability
AI Engineer World's Fair 202615:34
Your AI Agent Has No Nervous System — Matt Gibiec, Dynatrace
Matt Gibiec
Coding agents · Observability & reliability · Developer workflows & testing
AI Engineer World's Fair 202638:55
Building Self-Learning Loops for Your Agent — Fuad Ali, Arize AI
Fuad Ali
Agent engineering · Observability & reliability · Coding agents
AI Engineer NYC 2026 Online Talks15:04
The Agent Works. Does Anyone Trust It? — Michele Grant, Leading at Scale
Michele Grant
Safety & governance · AI engineering leadership · Human-in-the-loop validation
AI Engineer World's Fair 20261:57:33
AI Security Engineer Foundations + Certificate — Javier Garza, Snyk
Javier Garza
Safety & governance · AI security · MCP
AI Engineer World's Fair 202617:46
Why Building an Eval Platform Is Harder Than It Looks — Braintrust
Hossein Niazmandi
Evals · Observability & reliability · Infrastructure & deployment
53:04
Agents That Self Improve While You Sleep - Fuad Ali, Arize AI
Fuad Ali
Agent engineering · Observability & reliability · Evals
1:01:28
Lifestyles of the AI-Native — Nick Nisi & Zack Proser, WorkOS
Zack Proser · Nick Nisi
Coding agents · Voice AI · Agent orchestration
AI Engineer World's Fair 202617:44
Orchestras, Not Factories: How the Fastest Builders Work — Charlie Holtz, Conductor
Charlie Holtz
Coding agents · Sandboxes & isolation · Human-in-the-loop validation
AI Engineer World's Fair 202619:39
From Your Laptop to the Pipeline: Scaling Custom Agents with GitHub Copilot
Jose Palafox
Coding agents · Harness engineering · Agent engineering
AI Engineer World's Fair 202636:04
Let Your Agent Cook: Using Skills to Evaluate and Improve Your App — Ankur Duggal, Arize AI
Ankur Duggal
Evals · Observability & reliability · Coding agents
15:27
What Does an AI Engineer Do Now? - Aparna Dhinakaran, Arize AI
Aparna Dhinakaran
Agent engineering · Software factories · Observability & reliability
AI Engineer World's Fair 202641:57
SonarQube + OpenAI: Agentic Development — Killian Carlsen-Phelan, Sonar
Killian Carlsen-Phelan
Coding agents · Code review & verification · MCP
AI Engineer World's Fair 202624:40
The Death of the Code Review: What the Data Actually Says — Laurie Voss, Arize AI
Laurie Voss
Code review & verification · Coding agents · Evals
AI Engineer New York 202621:32
We Trust AI Agents That Break Every Day - Shy Ruparel, Temporal
Shy Ruparel
Observability & reliability · Agent engineering · Infrastructure & deployment
AI Engineer World's Fair 202622:00
Containment Is Lying to You: Measuring AI Agents Like Employees — Druid AI
Dan Bălăceanu
AI engineering leadership · Evals · Safety & governance
AI Engineer World's Fair 20261:07:24
Cooking with Codex — Charlie Guo & Gabriel Chua, OpenAI
Charlie Guo · Gabriel Chua
Coding agents · Agent orchestration · Agent engineering
AI Engineer World's Fair 202659:49
Evals in AI: A Deep Dive — Tejas Kumar, IBM
Tejas Kumar
Evals · Agent engineering · Developer workflows & testing
AI Engineer World's Fair 202618:25
You’re Not Thinking Big Enough: Rebuilding Food Systems with AI Agents — Cody Menefee, Firecrawl
Cody Menefee
Agent engineering · Vision & video · Human-in-the-loop validation
35:19
How to Write Your First AI Eval - SallyAnn DeLucia, Arize AI
Sally-Ann DeLucia
Evals · Observability & reliability · Prompting & in-context learning
AI Engineer World's Fair 202618:59
No, That's Not a Software Factory — Ryan Cooke, WorkOS
Ryan Cooke
Software factories · Developer productivity · Human-in-the-loop validation
17:59
The Transcript Looked Fine. The Call Wasn't. — Debugging Voice Agents, Arize
Fuad Ali
Voice AI · Observability & reliability · Evals
AI Engineer World's Fair 202617:06
The Self-Improving OSS Agent Stack — Marc Klingen, Langfuse
Marc Klingen
Agent engineering · Observability & reliability · Evals
AI Engineer World's Fair 202621:37
From Raw Documents to AI-Ready Data — Leo Platzer & Jeff Koss
Jeff Koss · Leo Platzer
Data quality & curation · Retrieval-augmented generation · Enterprise AI
AI Engineer World's Fair 202616:38
Giving AI Agents Memory That Learns — Jake Broekhuizen, LangChain
Jake Broekhuizen
Agent engineering · Agent memory · Continual learning
20:47
I Gave an AI a Body — Cyrus Clarke, MIT Media Lab
Cyrus Clarke
Robotics · AI interface design · Human-in-the-loop validation
19:02
Why AI Writing Still Reads Like Slop — Louis-François Bouchard, Towards AI
Louis-François Bouchard
Benchmarks · Evals · Prompting & in-context learning
AI Engineer World's Fair 202617:17
Generation Is Cheap, Review Is Expensive: How to Stop Shipping AI Slop — Gabriel Martinez, G2i
Gabriel Martinez
AI engineering leadership · Code review & verification · Developer productivity
AI Engineer NYC 2026 Online Talks20:27
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL
Somya Rai · MD Sharique
AI in finance · ML fundamentals · Fine-tuning
AI Engineer World's Fair 202619:33
Scale the Judgment, Not the Model — Andrew Orobator, Reddit
Andrew Orobator
Coding agents · Agent skills · Human-in-the-loop validation
21:14
Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase
Miguel González Fernández · Corby Rosset
Evals · Agent engineering · Computer use
AI Engineer World's Fair 202619:48
Inside 847 Production Clinical AI Notes — Sebastian Fox, Composo
Sebastian Fox
AI in healthcare · Evals · Human-in-the-loop validation
18:59
How OpenAI Built ChatGPT for Bankers and Analysts — Joseph Kim, OpenAI
Joseph Kim
AI in finance · Enterprise AI · MCP