About the Role
Focuses on legacy data migration, complex query optimization, and building new cloud pipelines for enterprise-scale data systems.
The position is 100% on-site in Columbus, Ohio and involves working within a hybrid big data architecture using modern data engineering technologies.
The Senior Data Engineer will play a critical role in data warehousing strategies, data quality assurance, and optimizing legacy Oracle and MS SQL Server environments. Responsibilities
Design, build, and optimize enterprise-scale data pipelines within a hybrid big data architecture.
Write highly complex SQL scripts, subqueries, and advanced analytics statements for massive datasets.
Develop targeted rules and algorithmic mappings specifically for data quality, accuracy, and lineage checks.
Oversee core Data Warehousing strategies, including data integration and aggressive data cleansing workflows.
Troubleshoot, debug, and optimize legacy setups natively in Oracle and MS SQL environments.
Perform legacy data migration and complex query optimization tasks.
Build and maintain new cloud data pipelines using Databricks and PySpark. Required Qualifications
6 to 8+ years of experience in pure Data Engineering or Architecture.
Minimum 2 years of active development experience using Python.
Minimum 3 years working with Cloud Technologies (AWS/Azure ecosystem).
Proficiency with Databricks, Python, PySpark, complex SQL, Oracle, and MS SQL Server.
Experience designing and optimizing enterprise-scale data pipelines.
Strong experience writing complex SQL scripts and advanced analytics statements.
Experience with data quality, accuracy, and lineage checks using rules and algorithmic mappings.
Experience with Data Warehousing strategies, data integration, and data cleansing workflows.
Ability to troubleshoot, debug, and optimize legacy Oracle and MS SQL Server environments.
Comfort working inside an Agile Scrum team environment. Required Skills & Technologies
Primary Skills
Databricks
Python
PySpark
SQL
Oracle
MS SQL Server Secondary Skills
AWS
Azure