▶ Watch ↗AI Engineer World's Fair 202622:29
From Ingestion to Agents: How AI Teams Build on Document Intelligence — Adit Abraham, Reducto
Read the full talk →Key ideas
Scroll to read ↓Adit Abraham of Reducto explains how to turn visually encoded documents into useful agent inputs: combine specialized models, correct OCR without rewriting the source, separate retrieval from reasoning, and give difficult extraction tasks tools and a verification loop.
- Combine efficient layout detection with VLM interpretation where visual complexity requires it; large models need not process every part of every page.8:44 ↗
- OCR correction should preserve what the document says, including its mistakes. Targeted token edits reduce the opportunity for a model to rewrite the underlying facts.9:44 ↗
- Format data for each consumer: natural-language table renderings for retrieval, and structure-preserving representations for reasoning.12:56 ↗
- Tool use and repeated verification can make difficult extraction tasks tractable, but extraction quality must include both correctness and completeness.17:35 ↗
- Evaluate individual stages and completed agent work, using production monitoring as well as test datasets. Agents choosing tools still need good inputs, relevant context, and usable outputs.19:14 ↗