AI Engineer Europe 202619:36
20 days of compute vs 7 hours: rethinking what state-of-the-art means — Bertrand Charpentier, Pruna AI
Bertrand Charpentier
Vision and video · Industry applications · Evals
← All topics
AI Engineer topic
Evals
272 AI Engineer conference talks about Evals.
AI Engineer World's Fair 202519:14
2025 is the Year of Evals! Just like 2024, and 2023, and …
John Dickerson
Safety and governance · Evals · Reasoning and models
AI Engineer World's Fair 202520:55
3 ingredients for building reliable enterprise agents
Harrison Chase
Evals · Coding and developer tools · Agent engineering
AI Engineer World's Fair 202522:00
360Brew: LLM-based Personalized Ranking and Recommendation — Hamed Firooz and Maziar Sanjabi, LinkedIn AI
Hamed Firooz · Maziar Sanjabi
RAG, context, and search · Evals · Infrastructure and deployment
AI Engineer World's Fair 202525:39
7 Habits of Highly Effective Generative AI Evaluations
Justin Muller
Reasoning and models · Evals · Observability and reliability
AI Engineer World's Fair 202511:58
A year of Gemini progress + what comes next
Logan Kilpatrick
APIs, MCP, and protocols · Evals · Reasoning and models
AI Engineer Europe 202623:58
Accelerating AI on Edge — Chintan Parikh and Weiyi Wang, Google DeepMind
Chintan Parikh · Weiyi Wang
Evals · Other / unclassified · Infrastructure and deployment
AI Engineer World's Fair 202620:51
Adaption Labs — Gradient-Free Continual Learning
Sara Hooker
Infrastructure and deployment · Reasoning and models · Industry applications
AI Engineer Summit 202513:31
Agent Evals: Finally, With The Map
Ari Heljakka
Evals · RAG, context, and search · APIs, MCP, and protocols
AI Engineer Code 202516:55
Agent Reinforcement Fine Tuning
Will Hang · Cathy Zhou
Data and model adaptation · Agent engineering · Coding and developer tools
AI Engineer Europe 202620:03
Agentic Evaluations at Scale — For Everybody
Nicholas Kang · Michael Aaron
Evals · Agent engineering · Creative and generative media
AI Engineer World's Fair 202520:01
Agentic Excellence: Mastering Evaluation of AI Agents with Azure AI Evaluation SDK
Cedric Vidal
Safety and governance · Evals · Coding and developer tools
AI Engineer World's Fair 202618:26
Agentic SDLC at Uber - Building Blocks for Uber’s Software Factory
Uday Kiran Medisetty · Adam Huda
Coding and developer tools · Safety and governance · Evals
AI Engineer Code 202517:37
Agents are Robots Too: What Self-Driving Taught Me About Building Agents — Jesse Hu, Abundant
Jesse Hu
Enterprise · RAG, context, and search · Data and model adaptation
AI Engineer World's Fair 202620:14
Agents at Scale: Inside MiniMax's Model and the Infrastructure Behind It
Dan Fu · Olive Song
Evals · Architecture · Agent engineering
AI Engineer World's Fair 202630:14
Agents Building Agents
Alfonso Graziano
Architecture · Agent engineering · Evals
AI Engineer Europe 202617:50
Agents Don't Do Standups: Building the Post-Engineer Engineering Org
Mike Spitz
Architecture · Evals · Enterprise
AI Engineer World's Fair 202619:17
Agents Need Feature Flags
Sachin Gupta
Agent engineering · Evals · RAG, context, and search
AI Engineer World's Fair 202518:39
Agents reported thousands of bugs, how many were real? - Ian Butler and Nick Gregory
Ian Butler · Nick Gregory
Coding and developer tools · Infrastructure and deployment · Evals
AI Engineer Summit 202529:10
AI Agents, Meet Test Driven Development
Anita Kirkovska
RAG, context, and search · Coding and developer tools · Observability and reliability
AI Engineer Code 202518:18
AI Consulting in Practice — Nathaniel Whittemore (NLW), Superintelligent
Nathaniel Whittemore (NLW)
Leadership · Infrastructure and deployment · Evals
AI Engineer World's Fair 202619:00
AI-Driven Multi-Document Correlation for Enterprise Financial Compliance and Fraud Detection
Varsha Shah
Finance · Enterprise · RAG, context, and search
AI Engineer Summit 202356:57
AI Engineering 201: The Rest of the Owl
Charles Frye
Enterprise · Evals · RAG, context, and search
AI Engineer Code 202519:15
AI Kernel Generation: What's Working, What's Not, What's Next
Natalie Serrino
Infrastructure and deployment · Evals · Other / unclassified
AI Engineer World's Fair 202519:31
AI Red Teaming Agent: Azure AI Foundry — Nagkumar Arkalgud & Keiji Kanazawa, Microsoft
Nagkumar Arkalgud · Keiji Kanazawa
RAG, context, and search · Safety and governance · Evals
AI Engineer World's Fair 202628:53
AI System Design: From Idea to Production
Apoorva Joshi
Safety and governance · Evals · Architecture
AI Engineer World's Fair 202620:07
ALPHALAB: Autonomous Multi-Agent Research Across Optimization Domains with Frontier LLMs — Brendan Rappazzo
Brendan Rappazzo
RAG, context, and search · Finance · Agent engineering
AI Engineer Summit 202520:55
Anthropic for VPs of AI
Alexander Bricken · Joe Bayley
Coding and developer tools · Infrastructure and deployment · Evals
AI Engineer World's Fair 202618:08
Benchmarking Coding Agents on New vs Legacy Codebases — Denys Linkov, Wisedocs
Denys Linkov
Agent engineering · Coding and developer tools · Healthcare
AI Engineer World's Fair 202515:44
Benchmarks Are Memes: How What We Measure Shapes AI—and Us
Alex Duffy
Evals
AI Engineer World's Fair 202612:49
Benchmarks: The Good, the Bad, and the Ugly
Ali Khial
Evals · RAG, context, and search · Coding and developer tools
AI Engineer Summit 20239:33
Best Practices for Evaluating Large Language Model Applications with llmeval: Niklas Nielsen
Niklas Nielsen
Evals · Coding and developer tools · Other / unclassified
AI Engineer Europe 202619:45
Beyond Code Coverage: Functionality Testing with Playwright
Marlene Mhangami
Coding and developer tools · Developer workflows and testing · APIs, MCP, and protocols
AI Engineer World's Fair 202620:30
Beyond Static Intelligence: Evaluating Continual Learning
Parth Asawa
RAG, context, and search · Evals · Safety and governance
AI Engineer World's Fair 20245:47
BotDojo Launch: Enhancing AI Assistants with Evaluations and Synthetic Data
Paul Henry
RAG, context, and search · Evals · Infrastructure and deployment
AI Engineer World's Fair 202514:25
Break It 'Til You Make It: Building the Self-Improving Stack for AI Agents
Aparna Dhinakaran
Evals · Reasoning and models · RAG, context, and search
AI Engineer World's Fair 202618:26
Bringing agents onto the world wide web
Paul Klein IV
Agent engineering · Coding and developer tools · Evals
AI Engineer World's Fair 202619:03
Bringing Continual Learning into Enterprises
Samuel Denton
Data and model adaptation · Enterprise · Safety and governance
AI Engineer Code 202552:08
Build a Prompt Learning Loop
SallyAnn DeLucia · Fuad Ali
Observability and reliability · RAG, context, and search · Evals
AI Engineer World's Fair 202637:45
Build Evals That Actually Matter - Nick Ung & Akshay Sharma, Lyft
Nick Ung · Akshay Sharma
Evals · Agent engineering · Infrastructure and deployment
AI Engineer Europe 20261:57:03
Build Your Own Deep Research Agent + Technical Writer
Louis-François Bouchard · Paul Iusztin · Samridhi Vaid
Creative and generative media · Agent engineering · Coding and developer tools
AI Engineer Europe 202618:22
Building a Chess Coach
Anant Dole · Asbjørn Steinskog
Agent engineering · Other / unclassified · Creative and generative media
AI Engineer World's Fair 202518:42
Building AI Products That Actually Work
Ben Hylak · Sid Bendre
Enterprise · Evals · Reasoning and models
AI Engineer World's Fair 202515:50
Building Applications with AI Agents
Michael Albada
Observability and reliability · Architecture · Evals
AI Engineer Summit 202317:24
Building Blocks for LLM Systems & Products
Eugene Yan
RAG, context, and search · Evals · Enterprise
AI Engineer World's Fair 202621:39
Building Closed-Loop Evals for a Multimodal Agent at Uber Scale
Soumya Gupta · Jai Chopra
Observability and reliability · Evals · Safety and governance
AI Engineer World's Fair 20251:54:06
Building Code-First AI Agents with Azure AI Agent Service — Cédric Vidal, Microsoft
Cedric Vidal
Evals · Coding and developer tools · Reasoning and models
AI Engineer Summit 202518:29
Building enterprise LLM agents that work
Shaan Desai
Evals · RAG, context, and search · Architecture