Tanmay Sahay · तन्मय
Reliability for AI Systems
tclngaamhyaimsay9.mo@a4 ---0561+0571675
Abstract. Customer-obsessed engineer with 8+ years of experience making service operability sustainable. Currently focused on reliability of Google DeepMind's Gemini models on Vertex AI — accelerator-backed LLM inference serving. Expert in automating complex infrastructure, reducing operational toil by >50%, and pioneering AI-powered troubleshooting. Proven track record of saving 30+ SWE-years through efficiency optimizations.
1Positions
Software Engineer, SRE (Gemini & Vertex AI LLM serving · Google DeepMind)
Google · Apr '25 - Present · US-MTV
tl;dr — Making Google Cloud's large language model offerings (Gemini, Veo, Imagen) more reliable. Check out cloud.google.com/vertex-ai
— Reliability owner for accelerator-backed inference serving at frontier-model scale — GPU/TPU fleet capacity, serving-stack rollouts, and the incident path for Gemini, Veo and Imagen traffic.
— Led the migration of Vertex AI's ML model-serving configurations to dedicated hermetic ML-Ops, removing a class of release-time serving outages and materially improving rollout safety.
— Automated the months-long turnup of Vertex AI in new regions, including accelerator capacity validation before traffic admission.
— Built a Gemini-powered incident framework that cuts MTTx through LLM-assisted triage and gated actuation — an agentic system running against live production.
Software Engineer, SRE (Network Infrastructure)
Google · Feb '24 - Apr '25 · US-MTV
tl;dr — Ensuring reliability for Google's global backbone network telemetry and monitoring systems.
— Navigated chaotic environment with constantly changing requirements while maintaining system stability.
— Successfully collaborated with NetInfra Telemetry teams to improve network observability.
— Built tooling to enhance network monitoring and alerting capabilities.
— Contributed to infrastructure supporting Google's global network operations.
Software Engineer, SRE (Cloud Infrastructure)
Google · Feb '23 - Feb '24 · CH-ZRH
tl;dr — Continued driving reliability improvements and tooling development from Zurich.
— Continued development and expansion of Khoj (InvDash), scaling adoption across Google SRE teams.
— Mentored junior engineers and drove knowledge transfer across regions.
— Contributed to cross-functional infrastructure reliability initiatives.
— Prepared for and executed smooth transition to US-based Network Infrastructure team.
Software Engineer, SRE (Serverless Platform)
Google · Mar '19 - Feb '23 · UK-LON / CH-ZRH
tl;dr — Enhanced reliability for Cloud Run, Cloud Functions, and App Engine.
— Reduced team's oncall load by over 50% through actionable metrics and democratization of data.
— Enabled safe, slow rollouts for 500+ Spanner databases, preventing global outages.
— Created 'Khoj' (InvDash) in 2021 — an automated incident root-causing system now used Google-wide and still actively maintained.
— Led Log4j Code Red response for Serverless products.
Creator & Lead Developer — Khoj (InvDash)
Google (Internal Project) · 2021 - Present · Global
tl;dr — Built and continuously evolved an automated incident investigation and root-causing system.
— Conceived and built Khoj in 2021 to automate tedious incident root-cause analysis.
— System correlates logs, metrics, and change events to surface probable causes during outages.
— Adopted Google-wide across multiple SRE teams, significantly reducing Mean Time To Diagnose (MTTD).
— Continuously maintained and enhanced over 4+ years, adapting to new infrastructure patterns.
Software Developer
Booking.com · Jun '17 - Feb '19 · NL-AMS
tl;dr — Machine Learning Services & Image Infrastructure.
— Reduced image serving latency by 50% and storage costs by 80% via on-the-fly resizing service.
— Built ML platform features used by 200+ Data Scientists.
— Migrated image building pipelines to Google Cloud Dataproc.
2Methods & instruments
programming — Python, Go, Java, C++, SQL, Shell.
sre & cloud — Kubernetes, Terraform, Bazel, GCP, Incident Response, Observability.
ai & ml — Vertex AI, LLM Ops, Gemini CLI, AI Agents, Model Serving, TPU Fleet Mgmt.
tools — Prodspec, Spanner, Bigtable, Prometheus/Monarch.
3Selected peer review
43 peer bonuses, spot bonuses and kudos from 37 colleagues, 2019–2025 — for collaboration (12), technical excellence (10), incident response (8), mentoring (6), leadership (4), innovation (2), automation (1). In their words:
"Thanks Tanmay for introducing me and keeping me up to date with all the innovative things happening in the world of AI. Your presentation on gemini-cli and how to prompt was awesome. Your push towards using AI to…"— colleague, Vertex AI, 2025 · Innovation
"Thank you for going above and beyond the call of duty in your response to the log4j security vulnerabilities in December 2021. Your commitment to securing Google and our customers is truly appreciated!"— colleague, Serverless, 2022 · Incident Response
"Being oncall in an understaffed rotation takes time away from your project work and personal life. Thank you Tanmay for enabling our team to persevere through this challenging time!"— colleague, Serverless, 2022 · Collaboration
"For collaborating with Cloud Functions SREs to ensure alignment and shared understanding of observability requirements during the GCF v2 launch preparation."— colleague, Serverless, 2019 · Collaboration
4Education & honors
B.Tech in Computer Science
IIIT Hyderabad · 2013 - 2017 · Hyderabad, India
— ACM ICPC Regional Finalist (2014, 2015) — among top competitive programmers in Asia.
— JEE Mains Rank 719 (Top 0.05%) out of 1.4M candidates nationwide.
— National Talent Scholar — recognized for academic excellence.
— CodeChef Campus Chapter Ambassador — organized coding competitions.
— Teaching Assistant for Algorithms & Data Structures courses.
5Languages
germanic — English (native), Dutch (conversational), German (basic).
romance — French (conversational), Spanish (basic).
indo-aryan — Hindi (native), Urdu (conversational), Kannada (fluent), Sanskrit (exposure).
scripts — Cyrillic.
6Citation
@misc{sahay2026,
author = {Sahay, Tanmay},
title = {Reliability for AI Systems},
year = {2026},
note = {ICPC regionalist; polyglot (9 languages);
reachable at the address above}
}