▶ Watch ↗AI Engineer World's Fair 20251:09:41
Conference affiliation: Daily · 2025
Aleix Conchillo Flaqué is a software engineer at Daily building Pipecat, the open-source framework for real-time voice and multimodal agents. His work connects conversational models with the software needed to use them: streaming media, interchangeable services, interruption handling, and tests that exercise an actual spoken exchange.
Conchillo’s open-source work stretches back to the early 2000s. His Simple C Expat Wrapper (SCEW) gives C programmers a document-oriented interface to XML. Instead of writing parser callbacks for each application, developers can load, inspect, modify, and create documents through a reusable library.
He also developed guile-json, whose implementation dates back to 2013. It translates JSON into native Guile Scheme values and back again, supporting individual documents and sequences of documents. His Guile Homebrew tap makes libraries and applications in that ecosystem easier to install on macOS; the Spritely Institute uses it as an installation route for Hoot, its Scheme-to-WebAssembly toolchain.
By 2017 and 2018, his technical writing was exploring practical problems in cloud infrastructure. He traced how Kubernetes routes traffic from a load balancer to a pod, then documented an upgrade that required custom machine images and investigation of a monitoring agent’s kernel dependencies. Both accounts follow a concrete question through the system’s underlying behavior, explaining why a deployment works or fails.
In 2019, he and a colleague added WebRTC monitoring to the Rumpus collaboration application. They streamed connection statistics from its Electron client through a gRPC backend into Prometheus and Grafana, making bitrate and packet-loss problems visible during meetings. This work brought the quality of a live media connection into the debugging process—a concern that carries into conversational AI.
At Daily, Conchillo builds the infrastructure around conversational models. He co-authored the company’s January 2025 account of its NVIDIA voice-agent collaboration, which combines Pipecat orchestration with NVIDIA NIM services. One important detail is conversation memory: when a person interrupts an agent, its context should reflect what was actually played aloud, rather than treating every generated word as something the person heard.
Two aspects of his work make that infrastructure concrete:
Conchillo developed the Pipecat MCP Server to make it possible to talk with a coding agent while away from the desk. Rather than requiring someone to remain at a terminal to interact with tools such as Claude Code, Cursor, or Codex, the project adds voice as another way to stay involved in the work.
The server exposes voice and screen-capture tools to MCP-compatible agents, while a separate browser, WebRTC room, or telephone connection carries the media. Local Whisper transcription and Kokoro speech synthesis provide an option without hosted speech services. This separation lets a coding agent retain its working environment while the person speaking with it uses a different connection. Conchillo extends Pipecat’s composable approach from building conversational applications to making development tools accessible through conversation.
▶ Watch ↗AI Engineer World's Fair 20251:09:41
Loading more talks and highlights…