Azure Data Engineer - Spark, PySpark, ADF, Databricks, Power BI

SHIVA SHANKAR KONDA

Azure Data Engineer Azure Cloud Databricks ADF ADLS Spark PySpark Python SQL Power BI

Phone: +91-630******* Email: *******.*****.*****@*****.*** Location: India LinkedIn: https://www.linkedin.com/in/shiva-shankar-konda/ PROFILE SUMMARY

• Azure Cloud & Data Engineering professional experienced in building scalable end-to-end data solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Databricks, and Azure SQL Database.

• Strong hands-on expertise in Spark / PySpark, Python, and SQL for ETL/ELT pipelines, data transformation, performance optimization, and automation.

• Skilled in creating business-ready dashboards and analytics reports using Power BI with focus on data quality, accuracy, and stakeholder requirements. TECHNICAL SKILLS

Category Skills

Cloud Platform Microsoft Azure

Data Engineering Azure Data Factory (ADF), Azure Databricks, ADLS Gen2, Azure SQL Database

Big Data Apache Spark, PySpark

Programming Python, SQL, JavaScript

Visualization Power BI

Data Concepts ETL/ELT, Data Pipelines, Data Validation, Data Warehousing

PROJECT

Azure Data Pipeline & Lakehouse Solution

• Developed scalable ingestion and transformation pipelines using Azure Data Factory (ADF) for structured and semi-structured sources.

• Stored raw and curated datasets in ADLS Gen2 following bronze-silver-gold architecture.

• Implemented PySpark transformations in Azure Databricks for cleansing, deduplication, and business logic.

• Optimized Spark jobs using partitioning, caching, and efficient joins to improve processing performance.

• Published curated data to Azure SQL Database and created Power BI dashboards for analytics and KPIs.

Power BI Analytics Reporting (Azure SQL + Databricks)

• Built interactive Power BI dashboards with drill-through reports, filters, and KPI visuals.

• Designed optimized SQL queries and data models for reporting and business intelligence.

• Performed data validation and reconciliation checks to ensure report accuracy. EDUCATION

B.Tech – Rajeev Gandhi Memorial College Of Engineering And Technology, 2017 – 2021 Electrical And Electronics Engineering CGPA – 7.0

Contact this candidate