Data Engineer

About the Role

We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, develop, and optimize enterprise-scale data pipelines. You'll play a key role in building scalable Lakehouse solutions while ensuring reliable, high-quality data for analytics, reporting, and downstream applications.

Key Responsibilities

Design and build scalable ETL/ELT pipelines using Databricks

Develop PySpark and Spark SQL transformations

Build Bronze, Silver, and Gold data layers using Medallion Architecture

Implement Delta Live Tables, Workflows, and Unity Catalog

Optimize Spark jobs for scalability and performance

Design dimensional data models for analytical workloads

Implement data quality validations and monitoring

Collaborate with analytics, engineering, and architecture teams

Build reusable frameworks and automation

Support CI/CD deployment pipelines and Git-based development

Required Qualifications

7–10+ years of Data Engineering experience

Extensive hands-on Databricks experience

Strong PySpark programming

Advanced Spark SQL skills

Experience with Delta Lake

Experience implementing Medallion Architecture

Hands-on Delta Live Tables

Unity Catalog experience

Strong SQL optimization and performance tuning

Experience with AWS, Azure, or GCP

CI/CD and Git experience

Strong understanding of distributed data systems

Experience designing enterprise data models

Preferred Qualifications

Databricks certification

Experience with streaming data

Experience building reusable data frameworks

Experience with enterprise governance

Exposure to AI-assisted development tools including Databricks AI Genie #LI-WJ1

#PSI2