Multimodality: AI Agents are becoming more powerful at a rapid pace! In this talk you will learn best practices and considerations to think about when building your AI Agent Swarm. All aspects from low latency Speech to Text, Large Language Model RAG and Fine Tuning and Text to Speech. I will share open source code for how to build an AI Agent you can talk to with sub second latency end to end! You will learn how you can scale your AI Agents to handle 1000s or millions of concurrent conversations.

Deepgram Account

• https://console.deepgram.com/signup

Requirements

• Browser
• Microphone
• Speaker / Headphones

Development Tools

• NodeJS (http-server)
• JavaScript, CSS, HTML

Repos

• https://github.com/DamienDeepgram/deepgram-workshop-client (Required)
• https://github.com/DamienDeepgram/deepgram-workshop-server (Optional)