Post Job Free
Sign in

Data Engineer

Company:
Proteam Solutions
Location:
Columbus, OH, 43215
Posted:
November 17, 2026
Apply

Description:

Job Description

About the Role\n\n

We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, develop, and optimize enterprise-scale data pipelines. You'll play a key role in building scalable Lakehouse solutions while ensuring reliable, high-quality data for analytics, reporting, and downstream applications.\n\nKey Responsibilities\n\n\n

Design and build scalable ETL/ELT pipelines using Databricks\n

Develop PySpark and Spark SQL transformations\n

Build Bronze, Silver, and Gold data layers using Medallion Architecture\n

Implement Delta Live Tables, Workflows, and Unity Catalog\n

Optimize Spark jobs for scalability and performance\n

Design dimensional data models for analytical workloads\n

Implement data quality validations and monitoring\n

Collaborate with analytics, engineering, and architecture teams\n

Build reusable frameworks and automation\n

Support CI/CD deployment pipelines and Git-based development\n\n\nRequired Qualifications\n\n\n

7–10+ years of Data Engineering experience\n

Extensive hands-on Databricks experience\n

Strong PySpark programming\n

Advanced Spark SQL skills\n

Experience with Delta Lake\n

Experience implementing Medallion Architecture\n

Hands-on Delta Live Tables\n

Unity Catalog experience\n

Strong SQL optimization and performance tuning\n

Experience with AWS, Azure, or GCP\n

CI/CD and Git experience\n

Strong understanding of distributed data systems\n

Experience designing enterprise data models\n\n\nPreferred Qualifications\n\n\n

Databricks certification\n

Experience with streaming data\n

Experience building reusable data frameworks\n

Experience with enterprise governance\n

Exposure to AI-assisted development tools including Databricks AI Genie\n\n#LI-WJ1

\n#PSI2

Apply