AI Engineer
← All speakers

AI infrastructure engineer

Ashish Kamra

Red Hat · 2026

Ashish Kamra was a senior manager of software engineering at Red Hat at World’s Fair 2026. His experience spans AI, cloud-native platforms and infrastructure, with a focus on building teams and improving enterprise AI performance. With Yuchen Fama, he examines how KV cache-aware routing and separating prefill from decoding affect inference latency under different workloads.

1 conference talk

AI Engineer World's Fair 202621:47

KV Cache-Aware Routing and P/D Disaggregation on Kubernetes — Yuchen Fama & Ashish Kamra, Red Hat

Yuchen Fama and Ashish Kamra explain KV cache-aware routing and prefill/decode disaggregation for agentic inference. They demonstrate faster responses through cache reuse, describe how separating prefill from decode can reduce streaming latency, and discuss workload and network conditions that determine whether disaggregation helps. An ongoing H200 case…

Yuchen Fama · Ashish Kamra

References