Shubha Swamy

Shubha Swamy

Software Engineer
San Francisco, United States.

Work

Capital One
|

Software Engineer

San Francisco, CA, US

Summary

Software Engineer designing and maintaining high-performance backend services powering Capital One's data governance platform, processing petabytes of data across AWS for over 100 internal teams.

Highlights

Designed and maintained high-performance backend services for Capital One's data governance platform, processing petabytes of data across AWS (S3, DynamoDB, RDS) used by 100+ internal teams.

Redesigned legacy batch workflows into an event-driven, real-time data pipeline using Spark, AWS Glue, EMR, and Lambda, significantly improving reliability and reducing metadata ingestion latency.

Optimized Spark and AWS Glue jobs to scale from 1 TB in pre-production to multi-petabyte workloads, enhancing performance and lowering infrastructure cost.

Led end-to-end service architecture from design and implementation to observability, utilizing OpenTelemetry to enable proactive monitoring and improve data quality.

Collaborated cross-functionally with data platform teams, internal customers, and product to ensure data quality, regulatory compliance, and seamless integration within enterprise systems.

Twitter
|

Software Engineer II

San Francisco, CA, US

Summary

Software Engineer II at Twitter, responsible for optimizing cloud infrastructure, leading critical security initiatives, and managing distributed systems serving millions of users.

Highlights

Cut cloud compute costs by $700K/year and reduced RPC overhead by 50% through caching and protocol optimization of authentication and authorization endpoints.

Led a company-wide, multi-team initiative to implement secure service-to-service authentication, achieving critical federal data privacy compliance.

Redesigned 10+ developer API endpoints with feature limits, significantly reducing abuse and external attack vectors.

Reduced cache retrieval latency by 10% and improved data write consistency across data centers by implementing Memcached.

Owned on-call operations and Tier-0 production deployments for distributed systems serving millions of users; earned promotion from SWE I to SWE II within 1 year.

Amazon Web Services (AWS)
|

Systems Development Engineering Intern

Seattle, WA, US

Summary

Systems Development Engineering Intern at AWS, building internal deployment automation tools to enhance efficiency for serverless teams.

Highlights

Built an internal deployment automation tool using React, Flask, and DynamoDB, saving AWS Serverless teams 1000+ hours/year.

Automated the creation, queuing, and tracking of deployments, significantly increasing reliability and response times for serverless operations.

Twitter
|

Software Engineering Intern

San Francisco, CA, US

Summary

Software Engineering Intern at Twitter, focusing on improving network performance and security for millions of users.

Highlights

Improved latency of Tweets and reliability for millions of users by routing edge traffic through Points of Presence.

Automated SSL certificate provisioning, configured network protocols, and minimized security risks while gathering performance metrics.

Education

University of Colorado Boulder
Boulder, CO, United States of America

B.S.

Computer Science

Courses

Thesis: Using Bigram Language Models and Perplexity to Quantify Bias in Recent American Election Journalism

Skills

Programming Languages

Python, Scala, Java, SQL, JavaScript/TypeScript.

Data Systems

Apache Spark, Distributed Systems, ETL Pipelines, Data Lakes.

Infrastructure & DevOps

AWS, Kubernetes, Docker, Terraform, Databricks, Git.

Tools & Technologies

React, OpenTelemetry, Unix/Linux, Agile, On-call.

Projects

Stanford + Bloomberg Beta Cohort Leader

Summary

Led weekly discussions on ethics, policy, and technology with professionals from diverse fields.

Interests

Cycling, Running, Hiking, Cooking, Podcasts, Reading