Azure Data Engineer - SAP S/4HANA to Lakehouse Expert

Unnatha Panchagiri

New Jersey, NJ 269-***-**** *******.****@*****.*** linkedin.com/in/unnatha-p-389822285

Summary

Azure Data Engineer with 4+ years of experience designing and maintaining scalable data pipelines and Lakehouse architectures

using Azure Data Factory and Databricks. Proficient in Python, PySpark, and SQL for integrating enterprise data sources like

SAP S/4HANA into Azure environments. Expertise in implementing robust data governance and security frameworks with Unity

Catalog to deliver optimized, high-performance ETL processes.

Education

Indiana Wesleyan University Marion, IN

Master of Science in Data Analytics (GPA: 3.77) 2023 – 2024

VBIT, Jawaharlal Nehru Technological University Hyderabad, India

Bachelor of Technology in Electronics & Communication Engineering 2017 – 2021

Technical Skills

Cloud Platforms: Azure (Data Lake Storage, SQL DB, Blob Storage), AWS (S3, EC2)

Data Engineering: Azure Data Factory (ADF), Databricks (PySpark, Delta Lake, Auto Loader), Spark Streaming

Languages & Scripting: Python (Pandas, PySpark), SQL, T-SQL, PowerShell, Bash

DevOps & IaC: Azure DevOps, GitHub Actions, Jenkins, CI/CD, Terraform, ARM Templates

Governance & Security: Unity Catalog, Azure Purview, Azure Key Vault, RBAC/ABAC, Data Masking

Monitoring & Tools: Azure Monitor, Grafana, ELK Stack, Spark UI, JIRA, Confluence

Experience

Data Engineer – Lakeshift Migration Project Jan 2024 – Present

Internship Remote

• Spearheaded the migration of critical SAP product datasets from legacy Azure SQL to a modern Databricks Lakehouse,

enhancing data accessibility and analytics capabilities.

• Architected and deployed automated Azure Data Factory (ADF) pipelines to manage incremental data loads from SAP

S/4HANA, processing over 5 million records daily.

• Engineered PySpark transformations for complex data validation and implemented Delta Lake optimizations, improving

query performance by 25% for downstream consumption.

• Established a comprehensive data governance framework by configuring Unity Catalog for fine-grained, role-based access

control and end-to-end data lineage tracking.

Data Engineer Nov 2022 – Dec 2023

GB Tech, Inc. (Client: Cloud OU Learning Platform) Middletown, DE

• Revamped mission-critical ADF ETL pipelines to integrate on-premise sources with Azure, authoring parameterized

workflows that enabled scalable full and incremental data loads.

• Accelerated data availability for analytics by 40% through strategic Delta Lake performance tuning and SQL query

optimization, significantly reducing latency for reporting.

• Bolstered data security by integrating Azure Key Vault for secrets management across all pipelines, eliminating hardcoded

credentials and ensuring compliance.

• Implemented real-time monitoring dashboards using Grafana and the ELK stack, decreasing incident response times by 30%

by providing proactive alerts on pipeline health.

Projects

Ticketmaster Event + Weather Data Pipeline Sep 2023 – Dec 2023

Python, Azure Data Factory, Databricks, Delta Lake, Power BI, REST APIs

• Constructed a real-time data ingestion pipeline using Python to consume Ticketmaster and weather APIs, centralizing data

for event-weather correlation analysis.

• Orchestrated data processing with Databricks and scheduled automated validation via ADF triggers, landing curated datasets

as Delta tables in ADLS Gen2 for reliable analytics.

• Delivered actionable insights by developing a Power BI dashboard that visualized correlations, enabling stakeholders to

understand weather’s impact on event attendance.

Certifications

Microsoft Certified: Azure Data Engineer Associate (In Progress)

Microsoft Certified: Azure Fundamentals

Contact this candidate