Azure Databricks ETL Data Quality Tester

CHANDRAGOUDA HUDED H

Bangalore, India *************@*****.*** +91-812**-*****

Professional Summary

ETL Tester with 5+ years of IT experience including 3+ years specializing in Data Warehouse and ETL Testing within Azure cloud environments. Strong expertise in validating complex data transformations using Azure Databricks

(PySpark) and SQL. Experienced in Medallion Architecture (Landing, Bronze, Silver, Gold), incremental and full load validations, and ensuring data accuracy across large-scale pipelines. Proven ability to collaborate with data engineers and business teams in Agile environments to ensure high-quality, reliable data systems. Core Skills & Tools

• ETL & Data Testing : ETL Testing, Data Validation, Source-to-Target Testing, Data Reconciliation, Data Profiling, Full & Incremental Load Validation, Business Rule & Transformation Validation, Medallion Architecture (Landing, Bronze, Silver, Gold)

• Big Data & Cloud : Azure Databricks (PySpark), Azure Data Factory (ADF), Azure Data Lake Storage

(ADLS Gen2)

• SQL & Databases : SQL (Joins, Subqueries, CTEs, Aggregations), MySQL, SQL Server (SSMS)

• API Testing : Postman, Swagger

• DevOps & Tools : Azure DevOps (Boards, Repos, Pipelines), Jira, Git

• Methodologies : SDLC, STLC, Agile (Scrum), Defect Management, UAT Support Professional Experience

Goavega Software India Pvt Ltd. –Quality Engineer Bangalore, India (May 2021 – Present)

• Performed end-to-end validation of ETL pipelines built using Azure Databricks and Azure Data Factory.

• Validated data movement across Landing, Bronze, Silver, and Gold layers ensuring completeness, accuracy, and transformation fidelity.

• Conducted Source-to-Target validation by comparing raw source data with transformed target datasets.

• Wrote complex SQL queries to validate aggregations, joins, transformations, derived columns, and business logic.

• Executed record count validation, NULL checks, duplicate checks, schema validation, and data type verification.

• Validated incremental loads, delta loads, and full load processing to ensure historical data accuracy.

• Ensured referential integrity between fact and dimension tables, including surrogate key validation.

• Tested partitioned Parquet datasets in ADLS for optimized storage and query performance.

• Performed data reconciliation between upstream systems and reporting layers.

• Monitored and validated Azure Data Factory pipelines to ensure successful execution and SLA compliance.

• Conducted data profiling to identify inconsistencies, missing values, and anomalies.

• Supported UAT and release validation by verifying Power BI reports against backend transformed datasets.

• Logged and tracked defects using Azure DevOps and Jira, including detailed RCA documentation.

• Collaborated with data engineers and business stakeholders to validate data mapping documents and transformation rules.

• Participated in Agile ceremonies including sprint planning, backlog refinement, and retrospectives. Education

• Bachelor of Engineering (ECE) – VTU, Belagavi (2015 – 2018)

• Diploma in ECE (BTE) – Oxford Polytechnic, Hubli (2012 – 2015) Declaration

I hereby declare that the information provided above is true and correct to the best of my knowledge and belief. I take full responsibility for the correctness of the information mentioned in this resume. Place: Bangalore

Date:

Contact this candidate