Senior Data Engineer Azure (ADF, Databricks, Spark)

Job Title: Senior Data Engineer – Azure (ADF, Databricks, Spark)

Location: Calgary, Canada

Work Mode: Work From Home (WFH)

Experience Required: 10+ Years Total 8+ Years Relevant

Shift: Standard Day Shift (No Shifts)

Background Check: Required Before Onboarding

Delivery Anchor: Anjaneyulu Jillellamudi

Job Description

We are seeking an experienced Senior Data Engineer to design and develop scalable ETL and data integration solutions using Azure Data Factory, Azure Databricks, and Apache Spark. The role involves building robust data pipelines, transforming enterprise data, ensuring high data quality, and delivering insights through Power BI reporting.

The ideal candidate will collaborate closely with business stakeholders to understand data requirements, perform data profiling, and deliver reliable analytics solutions.

Key Responsibilities

Design, develop, and maintain ETL pipelines using Azure Data Factory (ADF)

Build scalable data ingestion and transformation workflows based on business rules

Develop data processing solutions using Azure Databricks and Apache Spark

Collaborate with business teams to gather and finalize data requirements

Perform data profiling, cleansing, validation, and quality checks

Optimize data pipelines for performance, reliability, and scalability

Create and maintain Power BI reports and dashboards for business insights

Troubleshoot data issues and ensure data accuracy across pipelines

Document solutions, workflows, and best practices

Mandatory Skills

Azure Databricks

Azure Data Factory (ADF)

Apache Spark

Strong experience in ETL / Data Engineering

Desired / Secondary Skills

SQL

Experience with data warehousing and analytics platforms

Knowledge of cloud-based data architecture

Nice to Have

Experience with large-scale enterprise data platforms

Exposure to Power BI performance tuning and advanced modeling

Strong problem-solving and stakeholder communication skills