Data Engineer Cloud

KAVYA EDIGA

Azure Cloud Data Engineer

***********@*****.*** 612-***-**** Maple Grove, MN

WORK EXPERIENCE

Azure Cloud Data Engineer

Citi

Nov 2023 - current Remote (based in MN)

Architected and implemented Azure data solutions using Data Factory, Databricks, Synapse, and Data Lake Storage. Built scalable data pipelines with PySpark for ingestion, transformation, and loading of high-volume financial datasets. Optimized data storage and access patterns for analytical workloads using Synapse and ADLS Gen2.

Streamlined infrastructure deployment, reducing setup time by 30% through ARM templates and Terraform automation. Engineered CI/CD pipelines in Azure DevOps, enhancing deployment speed by 30% and improving version control efficiency. Enhanced security for over 500 Azure resources by leveraging Azure Active Directory and implementing robust RBAC, improving data access control.

Enhanced pipeline reliability by reducing errors by 30% through proactive monitoring with Azure Monitor and custom logging. Developed comprehensive technical documentation for data workflows and SOPs, enhancing team efficiency by 20%. ETL / Data Engineer

Tata Consultancy Services

Jul 2021 - Aug 2023 Chennai, India (Hybrid)

Engineered end-to-end ETL solutions for banking data, improving processing efficiency by 30% using Informatica PowerCenter and SQL Server.

Transitioned legacy ETL into Azure-native pipelines using ADF and Databricks, boosting processing efficiency.

Created interactive Power BI dashboards that enhanced KPI visibility, boosting user engagement by 20% across departments. Optimized over 100 SQL queries, enhancing performance by 30% through data cleansing and automated batch jobs using shell and Python.

Collaborated with DevOps and QA teams to enhance CI/CD pipeline efficiency, achieving a 30% faster deployment rate while ensuring top-notch data quality.

Developed comprehensive technical documentation and operational guides, enhancing efficiency for downstream teams by 30%.

CAREER OBJECTIVE

Azure Cloud Data Engineer with over 4

years of experience designing scalable

ETL pipelines using Azure Data Factory

and Databricks—expert in optimizing

data platforms and automating

infrastructure with Terraform and ARM

templates.

EDUCATION

Masters of Science

Data Analytics

Concordia University-St. Paul

Aug 2023 - Dec 2024

GPA: 3.66/4.0

Big Data

Quantitative Research

Data Visualization

Data Analytics

Bachelor of Technology

Computer Science

Jawaharlal Nehru Technological

University

2017 - 2021

SKILLS

Azure Cloud Platform: Azure Data

Factory (ADF), Azure Data Lake

Storage (ADLS), Azure Synapse

Analytics, Azure SQL Database, Azure

Storage, Azure Virtual Machines

Data Engineering Tools: Databricks

(PySpark), Azure DevOps, Git, ARM

Templates, Terraform

PROJECTS

Financial Analytics Platform

Developer

Developed modular Databricks/PySpark transformations and orchestration via ADF for ingestion, transformation, and staging. Automated deployments via Azure DevOps pipelines and ARM/Terraform to ensure consistency across environments. Implemented ADLS and Synapse data layering for staging, curated, and analytics use cases.

Applied RBAC and Azure AD-based access control for multitenant data environments.

Designed dashboards in Power BI to visualize fraud detection metrics, daily transaction trends, and operational insights. Established monitoring and alerting via Azure Monitor and Log Analytics for pipeline health and performance.

Collaborated with DevOps and security teams to align with compliance and governance mandates.

Delivered production-level SLAs within an Agile delivery framework.

Customer Engagement Insights

Developer

Converted CRM and transactional data into analytics-ready datasets using Informatica and Azure-based ETL.

Implemented parameterized workflows and job scheduling via shell scripts and Azure tools.

Built reconciliation and governance reports in Excel and integrated with Tableau dashboards for business teams. Improved churn prediction insights by collaborating with marketing teams to design engagement metrics.

Conducted root-cause investigations and applied fixes to recurring data anomalies.

Enhanced SQL scripts and ETL jobs for load performance; documented metadata and mapping artifacts.

Prepared adhoc reports for compliance and audit requirements. Languages & Scripting: Python, Scala,

PowerShell, SQL

BI & Analytics: Power BI, Tableau, SQL

Server Reporting

DevOps & Cloud Automation: CI/CD

pipelines, Infrastructure as Code

(ARM, Terraform)

Governance & Security: Azure Active

Directory (AAD), RBAC, data access

controls

Azure Data Factory

Azure SQL Database

Azure Blob Storage

Azure Data Lake

Data Warehousing

ETL Processes

Data Modeling

Azure Databricks

SQL Server

Data Analysis

Stream Analytics

Power BI

Azure Machine Learning

Python

CERTIFICATIONS

Microsoft Certified: Azure Data

Engineer Associate

Microsoft Certified: Azure

Administrator Associate

Databricks Certified Data Engineer

Associate

Microsoft Certified: Power BI Data

Analyst Associate

Terraform Certified Associate or ARM

equivalent

Contact this candidate