Bio, Work & Ideas

Tanmay Sah

Tanmay Sah is credited as an Independent AI Researcher in the recorded workshop Deep dive on LLM Inference at Scale, where he teaches model optimization through quantization and attention techniques. He co-developed TanML with Dolly Sah, an open-source toolkit for validating tabular machine learning models, and is a coauthor of its Journal of Open Source Software paper.

1 conference talk

1:28:12

Deep dive on LLM Inference at Scale — Harshul Jain, Audible & Tanmay Sah, Independent AI Researcher

This workshop explains LLM inference bottlenecks through attention, GPU memory, KV caching, and the prefill and decode phases. It covers model quantization and attention variants, then serving optimizations and workload-specific comparisons of vLLM and SGLang.

Harshul Jain · Tanmay Sah