Technical Lead - Databricks Platform Engineering

Job Title: Technical Lead â Databricks Platform Engineering

Type: Direct Hire, Permanent (Not open to 3rd party candidates or C2C. Sponsorship is not available)

Work Location: Hybrid in Charlotte, NC 28202 (2-3 days in the office per week)

Job Details

We are looking for a Technical Lead, skilled in Databricks platform engineering, for our client. Our client is building out a new Data Engineering division, and this role will be instrumental in its success. As Technical Lead, youâ ll have the chance to influence architecture, set best practices, and lead the adoption of Databricks at scale.

The Technical Lead will own the architecture, development, and operational excellence of the Databricks platforms, including integration with Microsoft Fabric, Purview, Semarchy (MDM), and Power BI.

This role requires a blend of hands-on engineering and leadership to design scalable, secure, and high-performing data ecosystems that power analytics, operational reporting, and data-driven innovation.

This permanent, direct-hire position is hybrid, with the person working in the office 2 to 3 days per week.

Responsibilities:

Define and execute enterprise data platform strategy across Databricks, Microsoft Fabric, Semarchy, and Power BI, ensuring alignment with business priorities, governance, and scalability.

Lead architecture, design, and optimization of the Databricks Lakehouse, Power BI environment, and supporting data pipelines for advanced analytics, AI, and enterprise reporting.

Serve as SME on platform capabilities, integration patterns, and best practices, while driving automation, efficiency, and reusability across workflows.

Ensure data pipelines, models, and reporting meet SLAs for performance, accuracy, and reliability, with CI/CD, testing, and version control.

Enforce security, privacy, and compliance standards (e.g., CCPA, HIPAA, CFIUS), alongside policies for governance, cataloging, lineage, and metadata management.

Collaborate across engineering, analytics, governance, and business teams; provide training and upskilling to maximize adoption and platform expertise.

Continuously evaluate emerging tools and features, recommending enhancements to improve scalability, efficiency, and platform reliability.

Drive automation and efficiency improvements across data ingestion, mastering, and reporting workflows.

Promote reusability, scalability, and reliability in all platform engineering work.

Required Qualifications & Skills:

10+ years of experience in data engineering and platform leadership roles.

Proven hands-on expertise with Databricks, Microsoft Fabric, and Power BI in an enterprise setting.

Experience designing and managing large-scale, multi-domain data architectures.

Expert knowledge of Databricks SQL, Delta Lake, Spark, and data pipeline orchestration.

Deep understanding of Microsoft Fabric components (Data Factory, Data Warehouse, OneLake, Lakehouse).

Semarchy MDM skills, including data modeling, workflow design, matching rules, and stewardship processes.

Advanced Power BI DAX, data modeling, and performance tuning skills.

Proficiency in SQL, Python, and cloud data services (Azure preferred).

Bachelorâ s or masterâ s in computer science, Data Engineering, Information Systems, or related field.

Exceptional leadership, stakeholder management, and communication skills.

Ability to translate business needs into technical solutions.

Strong problem-solving and decision-making abilities.

Compensation:

The Comp consists of a Base Salary ranging from $160,000 to $195,000 per year plus Bonus. Also included is Full Medical / Dental / Vision, unlimited PTO, and 401k.

The compensation decisions are dependent on the facts and circumstances of each case, such as skills and experience levels.

#LI-TU1

#LI-Hybrid