▶ Watch ↗AI Engineer World's Fair 202622:10
Distill the LLM, Don't Serve It: Search & Personalization at DoorDash — Raghav Saboo, DoorDash
Read the full talk →Key ideas
Scroll to read ↓DoorDash uses expensive reasoning offline to teach fast retrieval and ranking models what shoppers mean. Graded relevance labels, semantic IDs and reusable consumer memory then support everything from better search results to personalized store collections.
- Graded relevance separates satisfying a shopper’s constraints from merely being popular or related. DoorDash uses offline LLM labels to teach that distinction to both retrieval and ranking.3:26 ↗
- Two-stage retrieval training uses the first model’s mistakes to build a harder curriculum. Ranking adds an explicit relevance objective alongside clicks, add-to-cart events and conversion.6:46 ↗
- Semantic IDs and consumer memory supply reusable meaning: catalog neighborhoods help with sparse items and query reformulation, while text, vectors and graphs make shopper context useful to different model types.11:05 ↗
- Personalized collections combine offline LLM generation with existing item hydration and ranking. The broader architecture captures reasoning once and lets several fast serving systems benefit from it.19:29 ↗