Lance Martin - Architecting and Testing Controllable Agents
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_88_e0c213c7a3.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_85_09c92b26be.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_80_d3f006a163.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_79_8106f419fa.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_86_771593e3f3.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_78_65d8f2b230.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_89_90f388b61d.jpg)
![](https://aie-cms-uploads.s3.us-west-1.amazonaws.com/AIE_Summit_2024_Day_1_WEB_87_bb2f64a815.jpg)
Evals & LLM Ops: LLM-powered autonomous agents combine (1) Tool calling, (2) Memory, and (3) Planning to autonomously perform tasks. While they hold tremendous promise, agent reliability has been a barrier for large-scale deployment and productionisation. We’ll cover ways to design and build reliable agents using LangGraph, which can support diverse self-corrective applications such as RAG and code generation. But, just as critically, we’ll cover ways to use LangSmith to test your agents, examining both agent's final response as well as agent tool use trajectories. Collectively, we’ll talk about three types of testing loops you can incorporate into your agent design process - at run time, pre-production, and for production monitoring.
Lance has been at LangChain for a year, working across open source python, langgraph, and langgraph projects. Here has two LangChain video series focused on RAG, LangSmith Evaluation and various popular videos on LangGraph (e.g., local agents for RAG, code generation). Prior to LangChain, he spent several years in technical leadership positions focused on applied AI in the self-driving industry (Ike and Uber ATG) and obtained a PhD from Stanford.
Lance has been at LangChain for a year, working across open source python, langgraph, and langgraph projects. Here has two LangChain video series focused on RAG, LangSmith Evaluation and various popular videos on LangGraph (e.g., local agents for RAG, code generation). Prior to LangChain, he spent several years in technical leadership positions focused on applied AI in the self-driving industry (Ike and Uber ATG) and obtained a PhD from Stanford.
We have now sold out of Early Bird tickets; General Admission has also sold out.
Please join us online for the free livestream.