How Instacart transformed its search and discovery using an LLM-driven approach
AI Engineer World's Fair 2025 · 21:10
Grocery marketplace and retail technology
Instacart operates a grocery marketplace for delivery and pickup and supplies technology for retailers’ online and in-store operations. Storefront Pro powers retailers’ own digital grocery stores, while FoodStorm connects online ordering with in-store food preparation. Caper Carts use AI to offer personalized shopping, savings opportunities and streamlined checkout. Its advertising business includes Carrot Ads, which lets retailers, marketplaces and commerce partners operate advertising businesses across their online and physical stores.
Founded in 2012 by Apoorva Mehta, Max Mullen and Brandon Leonardo, Instacart began delivering groceries in the San Francisco Bay Area. Chris Rogers now serves as CEO and chairperson. Its internal Griffin machine-learning platform brings feature management, training, model registration and real-time inference into a shared service. The Griffin 2.0 architecture uses Ray for distributed training and Kubernetes to unify training backends, giving engineers a common workflow for developing and deploying models.
In 2026, the company reported partnerships with more than 2,200 retail banners, representing nearly 100,000 stores. Its enterprise business also extends internationally: the completed 2026 acquisition of Instaleap added fulfillment technology and relationships with nearly 100 grocery retailers and marketplaces outside North America. Instaleap’s operations across nearly 30 countries span Europe, Latin America and the Middle East.
AI Engineer World's Fair 2025 · 21:10
Affiliations reflect their AIE appearances, not necessarily current employment.
The talk describes using a distilled Llama 8B model to address long-tail coverage, alongside the practical demands of managing latency and cost.
Affiliations reflect each recorded session, not necessarily current employment.