Shubha Swamy

Designed and maintained high-performance backend services for Capital One's data governance platform, processing petabytes of data across AWS (S3, DynamoDB, RDS) used by 100+ internal teams.

Redesigned legacy batch workflows into an event-driven, real-time data pipeline using Spark, AWS Glue, EMR, and Lambda, significantly improving reliability and reducing metadata ingestion latency.

Optimized Spark and AWS Glue jobs to scale from 1 TB in pre-production to multi-petabyte workloads, enhancing performance and lowering infrastructure cost.

Led end-to-end service architecture from design and implementation to observability, utilizing OpenTelemetry to enable proactive monitoring and improve data quality.

Collaborated cross-functionally with data platform teams, internal customers, and product to ensure data quality, regulatory compliance, and seamless integration within enterprise systems.

Cut cloud compute costs by $700K/year and reduced RPC overhead by 50% through caching and protocol optimization of authentication and authorization endpoints.

Led a company-wide, multi-team initiative to implement secure service-to-service authentication, achieving critical federal data privacy compliance.

Redesigned 10+ developer API endpoints with feature limits, significantly reducing abuse and external attack vectors.

Reduced cache retrieval latency by 10% and improved data write consistency across data centers by implementing Memcached.

Owned on-call operations and Tier-0 production deployments for distributed systems serving millions of users; earned promotion from SWE I to SWE II within 1 year.

Built an internal deployment automation tool using React, Flask, and DynamoDB, saving AWS Serverless teams 1000+ hours/year.

Automated the creation, queuing, and tracking of deployments, significantly increasing reliability and response times for serverless operations.

Improved latency of Tweets and reliability for millions of users by routing edge traffic through Points of Presence.

Automated SSL certificate provisioning, configured network protocols, and minimized security risks while gathering performance metrics.