13:13
Realtime Voice Agents with Frontier Intelligence — Bohan Li, EliseAI
Bohan Li explains techniques for reducing latency in a cascaded voice-agent system while using slower language models. The presentation covers speculative transcription, early response generation with background tool calls, and cached speech prefixes combined with newly synthesized audio. A recorded clinic-booking demonstration is followed by closing…
Bohan Li