Senior Data Engineer - Azure/AWS/GCP Lakehouse

RAJESWARI THEEGALA

Lombard, IL 216-***-**** *********.*@*********.*** LinkedIn

SUMMARY

Data Engineer with 5+ years building cloud-native lakehouse and streaming platforms using Python, SQL, and Scala on Azure (ADF, Synapse, Databricks), AWS, and GCP (BigQuery, Dataflow); reduced report SLAs from 8 hours to 22 minutes, saved $180K/year via CDC pipelines, and cut pipeline onboarding from 2 weeks to 3 days through CI/CD automation.

WORK EXPERIENCE

Humana Feb 2025 – Present

Senior Data Engineer

Designed Medallion lakehouse on Azure Databricks + Delta Lake ingesting 12+ claims, EMR, and pharmacy sources via PySpark + Python; cut SLA from 8 hours to 22 minutes for 3M+ daily records.

Engineered ADF pipelines (Linked Services, Integration Runtimes, parameterized datasets) into ADLS Gen2 via ARM templates + Azure DevOps CI/CD; reduced data lag by 70% across 6 OLTP sources.

Delivered CDC ingestion via Debezium + Kafka Connect into Apache Iceberg with MoR upserts; eliminated nightly batch loads saving $180K/year.

Wrote SQL transformation logic on Databricks for 200+ clinical dimension tables; standardized schema contracts across 5 teams, reducing ad-hoc fix time by 35%.

Authored Scala Spark jobs for stateful sessionization of ADT events, cutting memory overhead by 40% vs. PySpark UDFs; enforced HIPAA via Azure Purview and DataHub lineage. PNC Financial Services Aug 2024 – Jan 2025

Data Engineer

Architected payments lakehouse on Azure Synapse Analytics + Apache Hudi consolidating 8+ ACH/wire/card/Zelle sources; enabled sub-minute settlement reconciliation for 5M+ daily transactions.

Built Python-based data quality framework using Great Expectations in Airflow across 150+ financial tables; enforced PCI-DSS masking and cut data defect rate by 45%.

Wrote complex SQL (window functions, CTEs) on Azure Synapse for AML transaction pattern analysis; reduced compliance query runtime by 60% across 10M+ daily records.

Deployed Azure DevOps CI/CD for dbt model promotion across dev/staging/prod with PCI-DSS masking; achieved 99.6% data accuracy across 150+ financial tables. Infinite Infolab Jun 2020 – Jul 2023

Associate Data Engineer

Developed 20+ ELT pipelines in Python + AWS Glue ingesting billing events from 6 sources into Redshift; cut data lag from overnight to under 2 hours for 500K+ accounts.

Built GCP BigQuery + Cloud Dataflow pipelines migrating 500GB from Redshift; enabled cross-platform analytics with same-day freshness vs. prior T+2 batch cycle.

Authored SQL data marts on Redshift for MRR, churn, and cohort retention; replaced 3 manual Excel workflows and cut finance reporting prep time by 70%.

Implemented GitHub Actions CI/CD for dbt testing and Redshift deployments; reduced release cycle from bi- weekly to daily with zero production incidents over 6 months. SKILLS

Azure: ADF, Synapse Analytics, Databricks, ADLS Gen2, Event Hub, Azure Purview, Azure DevOps, ARM Templates, Microsoft Fabric

GCP: BigQuery, Cloud Dataflow, Dataproc, Cloud Storage, Cloud Pub/Sub AWS: S3, Glue, Redshift, Lambda, IAM

Data Engineering: PySpark, Scala, SQL, Apache Spark, Delta Lake, Apache Iceberg, Apache Hudi, Medallion Architecture, dbt, Snowflake, ETL Development

Streaming: Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink, Debezium CDC, Structured Streaming CI/CD & Infra: GitHub Actions, Azure DevOps, Terraform, Docker, Kubernetes, Git Governance: Great Expectations, DataHub, HIPAA, PCI-DSS, OpenLineage, Apache Airflow EDUCATION

Kent State University, Kent, OH Dec 2024

Master of Science in Business Analytics

Contact this candidate