Senior Software Engineer at ServiceNow • Hyderabad, India

Mahendra Yadav

Distributed Systems, Cloud Platforms & Platform Engineering

I have 9+ years building and running cloud-native distributed systems and internal platforms, mostly in Go and Python on AWS, Azure, and Google Cloud.

At ServiceNow, I own the technical vision and governance for enterprise platform APIs and agentic workflows, standardizing RBAC, observability, and rate-limiting across distributed engineering teams. Previously at Thoughtworks, I led architecture and cloud infrastructure for Singapore’s national health platform—delivering high-resilience systems for 500,000 citizens, zero-trust Kubernetes clusters, and streaming platforms processing 2M+ CDC events daily.

Portrait of Mahendra Yadav
~50K
Daily AI API Requests
Snowflake Cortex platform API serving 8+ engineering teams @ ServiceNow
~2M
Daily CDC Events
Real-time event-driven streaming via HDInsight Kafka & Debezium
500K+
National Platform Users
Health Promotion Board, Singapore health-data infrastructure
~$8K/mo
Cloud Spend Saved
Hub-and-spoke Azure Databricks compute architecture & tuning

Engineering Philosophy

A few principles I've settled on after nine years of building and running distributed systems.

01

Design for failure, operate for clarity

Things break. Brokers drop, jobs stall, nodes run out of memory. I build systems that degrade gracefully and make their failures visible, instead of quietly hoping they won't.

02

Governance is a feature, not friction

When many teams share one platform, contracts, access control, and observability aren't overhead. They're the product. I'd rather build that in from the start than bolt it on later.

03

Cost is an architectural property

Efficiency is a design constraint, not a quarterly cleanup. Cost, latency, and reliability are decisions you make up front, because that's when they're still cheap to change.

04

Boring primitives, deliberately applied

I reach for proven tools and keep novelty off the critical path. The interesting complexity belongs in the problem I'm solving, not in the stack that has to hold up at 3 a.m.

Systems & Platform Case Studies

Notes on the distributed platforms, streaming systems, and infrastructure I've built for enterprise production.

Enterprise AI Platform API & Agentic Systems

ServiceNow • Since 2024

I designed the internal platform API around Snowflake Cortex Analyst and Agent and run it as a shared, governed service for ~8 internal engineering teams. That covers API contracts, role-based access control, rate limiting, and observability, plus the integration work to wire it into enterprise AI, agentic workflows, and Microsoft Teams.

Impact: Handles ~50,000 requests/day; reduced manual competitive-intelligence research time by ~30% and expanded coverage across 5 new data domains.
Go Python Snowflake Cortex LangGraph Agentic Workflows REST Microsoft Teams

National Health Data Platform & Azure Databricks Architecture

Thoughtworks • HPB Singapore

I ran the infrastructure side of Singapore's national health data platform, which serves ~500,000 citizens. The biggest change was moving to a hub-and-spoke Azure Databricks workspace topology, which removed cross-workspace compute redundancy and isolated sensitive healthcare workloads. I also tracked down memory and partition problems that were destabilizing the HDInsight Spark clusters.

Impact: Slashed cross-workspace compute spend by ~20%, reduced Spark job failure rate by ~40%, and yielded ~$8,000/month in direct Azure cloud savings.
Azure Azure Databricks Apache Spark Go Terraform FinOps Azure Monitor

Real-Time CDC Event Streaming (Kafka + Debezium)

Thoughtworks • Data Platform

Built and ran an event-driven Change Data Capture (CDC) pipeline on an HDInsight Kafka cluster with Debezium connectors. It picks up transactional changes from the source databases as they happen and pushes them to downstream analytics engines and data catalogs, without adding lock contention on the primary OLTP tables.

Impact: Handled ~2,000,000 CDC events/day with sub-second event propagation, supporting both continuous streaming and ~5 TB/day batch Spark pipelines.
Apache Kafka Debezium Event-Driven Architecture Apache Airflow HDInsight Python

Kubernetes Calico Micro-Segmentation & CD4ML Pipeline

Thoughtworks • Healthcare & Daimler

Locked down production Kubernetes clusters with Calico network policies, isolating namespace traffic and shrinking the pod-to-pod attack surface. On the Daimler DataOps work, I built a standard Continuous Delivery for Machine Learning (CD4ML) pipeline with MLflow, DVC, and Jenkins so model training and deployments were reproducible and versioned.

Impact: Cut ML model deployment cycle from ~3 days to a few hours; resolved 12 critical Purview catalog security findings; lowered MTTD by ~50% with Azure Monitor.
Kubernetes Calico CNI CD4ML MLflow DVC CI/CD Purview

High-Velocity Notification Engine & GCP Automation

BeautifulCode • Sojern (Travel Ad-Tech)

Wrote a small, concurrent notification service in Go and gRPC for booking status changes and campaign alerts across the travel ad-tech services. I also automated provisioning on Google Cloud Platform so teams could spin up throwaway test environments whenever they needed one.

Impact: Scaled notification throughput to ~100,000/day; cut test environment provisioning turnaround from ~4 hours to ~15 minutes.
Go gRPC Python Django Google Cloud (GCP) Docker

Work History

Nine years of building and running production systems across healthcare, ad-tech, and enterprise software.

Oct 2024 · Present
ServiceNow
Hyderabad, India

Senior Software Engineer

  • Led a team of six on competitive-intelligence work across unstructured data sources. The tooling cut manual research time by ~30% and opened up coverage of 5 new data domains.
  • Built the internal platform API around Snowflake Cortex Analyst and Agent as a shared, governed service. Roughly 8 internal teams use it, and it handles ~50,000 requests/day.
  • Worked across teams to integrate the API with enterprise AI, agentic workflows, and Microsoft Teams, taking each integration through the usual contract, security, and scaling review.
  • Reviewed code and raised the team's engineering bar, and broke epics into work that actually fit a sprint, which tightened predictability by ~20%.
  • Ran the infrastructure roadmap for a big-data platform and restructured legacy components, saving roughly 10 hours a week in operational overhead.
  • Built an alerting service from scratch. Incident detection went from ~45 minutes to under 5 minutes.
  • Mentored three engineers, all of whom moved into senior individual-contributor roles.
Go Python Snowflake Cortex LangGraph REST Observability
Mar 2020 · Oct 2024
Thoughtworks
Hyderabad, India

Application Developer (Lead Consultant)

Project: Health Promotion Board, Singapore
  • Owned the infrastructure for a national health data platform serving ~500,000 users.
  • Built Go services for access management and reporting that became standard tooling across the engineering org.
  • Moved to a hub-and-spoke Azure Databricks architecture, cutting cross-workspace compute by ~20% and saving ~$8,000/month in Azure spend.
  • Ran the security review on a data-catalog application and closed 12 critical findings.
  • Fixed stability problems in an HDInsight Spark cluster that were causing job failures, dropping the failure rate by ~40%.
  • Set up centralized logging and alerting in Azure Monitor, which cut mean time to detection (MTTD) by ~50%.
  • Ran an HDInsight Kafka cluster with Debezium for real-time CDC streaming, processing ~2 million events/day.
  • Hardened Kubernetes clusters using Calico network policies to shrink the pod-to-pod attack surface.
  • Built batch pipelines in Python, Airflow, HDInsight, and Spark that process ~5 TB of data a day.
  • Mentored new joiners on infrastructure and data engineering.
Project: Daimler • Data Ops & CD4ML
  • Built CI/CD pipelines for data and ML work, cutting model deployment from ~3 days to a few hours.
  • Standardized how data-science teams trained and deployed models, using CD4ML practices.
  • Used MLflow, DVC, Jenkins, and HDFS for versioned storage and experiment tracking.
Project: Telemedicine Platform
  • Worked with the team to secure PII across the DevOps pipeline, for healthcare data-protection compliance.
  • Set up AWS Data Migration Service to provision sanitized, non-PII data for consumer-facing access, which unblocked a few downstream analytics use cases.
Go Python Azure AWS Kubernetes Calico Databricks Kafka Debezium Terraform
Mar 2018 · Mar 2020
BeautifulCode
Hyderabad, India

Full Stack Developer

Project: Campaign Management Platform • Sojern (Travel Ad-Tech)
  • Built microservices for an ad-tech campaign platform in Python, Django, gRPC, and React, supporting ~150 active campaigns a day.
  • Wrote dynamic provisioning scripts on GCP so teams could create their own test environments, cutting provisioning from ~4 hours to ~15 minutes.
  • Ran provisioning and operations for dev and test environments.
  • Designed a Go and gRPC notification service that handles ~100,000 notifications/day for campaign and booking status alerts.
Go Python Django gRPC Google Cloud React Docker
Dec 2016 · Mar 2018
Azri Solutions
Hyderabad, India

Jr Software Engineer

Project: GRNConnect (B2B Travel & Hospitality)
  • Automated data ingestion and ETL with Python and Airflow, saving ~15 hours/week of manual work.
  • Built Elixir/Phoenix microservices for a hospitality client, supporting ~500 concurrent users.
Python Apache Airflow Elixir Phoenix ETL

Engineering Notes & Writing

Notes on distributed systems, event streaming, cloud architecture, and platform engineering.

Cloud Certifications

Certifications across Google Cloud and Microsoft Azure.

Google Cloud
Professional Cloud Architect
Verify credential
✓ Certified
Google Cloud
Associate Cloud Engineer
Verify credential
✓ Certified
Microsoft
Azure Administrator Associate
Verify credential
✓ Certified
Microsoft
Azure Developer Associate
Verify credential
✓ Certified

Technical Skills

Tools and platforms I've used in production over the last nine years.

Languages
Go (Golang) Python Node.js Elixir SQL Bash
Cloud & Platform
Google Cloud (GCP) Microsoft Azure AWS Kubernetes Terraform Ansible Helm Docker Calico CNI
Distributed Systems & APIs
Apache Kafka Debezium CDC gRPC Protocol Buffers Event-Driven Architecture Microservices REST
AI & Applied ML
Snowflake Cortex Analyst Snowflake Cortex Agent LangGraph LangChain LangSmith MLflow CD4ML Prompt Engineering & Eval
Observability, CI/CD & Security
OpenTelemetry Grafana Jaeger Azure Monitor Argo CD Jenkins GitLab CI SonarQube PII Protection
Data & Databases
Snowflake Azure Databricks (Spark) PostgreSQL MySQL Redis Apache Airflow HDFS Microsoft Purview

Speaking & Technical Leadership

Conference presentations, internal knowledge forums, and engineering mentorship.

Managing Data Pipelines using Airflow
PyConf Hyderabad 2017

A talk on writing Airflow DAGs that survive failure: task retries, dependency design, and how to stop one bad task from taking down a pipeline.

Internal Tech Forums & Community Sessions
Thoughtworks & Local Meetups

Ran internal knowledge-sharing forums that grew to ~30 engineers, and gave talks on Docker, database sharding, and distributed systems basics.

Mentorship & Education
Dr B C Roy Engineering College (2013 to 2017)

Mentored 8+ engineers across ServiceNow, Thoughtworks, and BeautifulCode, most of whom moved into senior individual-contributor roles. B.Tech in Computer Science & Engineering.

Now Last updated Oct 2026
Currently
Senior Software Engineer at ServiceNow, building governed platform APIs and agentic workflows on Snowflake Cortex (~8 teams, ~50K requests/day).
Focus
Distributed systems, event-driven architecture, cloud platform engineering, and AI platform governance.
Based in
Hyderabad, India.
Open to
Senior / staff engineering roles and distributed-systems conversations.

Get in Touch

Happy to talk about distributed systems, event streaming, cloud platform work, or senior engineering roles.

Copied to clipboard: [email protected]