← All popular talks

Popular talk #20

RAG Agents in Prod: 10 Lessons We Learned — Douwe Kiela, creator of RAG

Douwe Kiela16:56Event session

Synced transcript

Follow the talk

Intro
Context Paradox
Systems, Not Models
Specialization
Data Moat
Production Focus
Speed Over Perfection
Engineer Focus
Wow Users
Beyond Accuracy
Be Ambitious

Community discussion

What did you agree with—or push back on?

Specific reactions make these talks more useful. Draft here, add the moment you’re discussing, then choose the direct-post pilot or the YouTube handoff.

Automated overview

What this talk covers

Douwe Kiela, CEO of Contextual AI and creator of RAG, shares 10 lessons from deploying enterprise RAG systems at scale. He argues that language models are only 20% of a larger system; success comes from focusing on systems, not models, and specializing over AGI to unlock domain expertise. Enterprise data is the real moat, but pilots are easy while production is hard—design for production from day one. Speed beats perfection: ship barely functional to real users early and iterate. Avoid boring engineering chores like chunking; instead, integrate AI into existing workflows to drive adoption. Accuracy is table stakes; handle inaccuracy with observability and attribution. Be ambitious: aim for transformative ROI, not low-hanging fruit like basic HR questions.

This overview is derived from the transcript and has not been independently fact-checked by AI Engineer.

Chapters

  1. 0:00Intro
  2. 0:42Context Paradox
  3. 4:24Systems, Not Models
  4. 5:49Specialization
  5. 6:46Data Moat
  6. 7:46Production Focus
  7. 9:21Speed Over Perfection
  8. 10:00Engineer Focus
  9. 11:02Easy Consumption
  10. 12:08Wow Users
  11. 13:20Beyond Accuracy
  12. 14:40Be Ambitious