Senior Azure Data Engineer

Job Description

Job Title: Senior Azure Data Engineer

Department: Health Fund

Reports To: Manager, Data Engineering

FLSA Status: Exempt

Position Summary:

As a Senior Azure Data Engineer, you will play a key role in managing and developing scalable, secure, and high-performing data solutions that power 32BJ Health Fund’s mission to deliver high-quality, low-cost healthcare to its union members. You will serve as a technical project lead in the design, development, and optimization of modern data pipelines and architectures in Azure, while mentoring junior engineers and collaborating closely with product and analytics teams to deliver robust data solutions.

This position reports to the Data Engineering Manager and works within a cross-functional environment alongside junior and senior engineers, analysts, and stakeholders from operations and IT.Primary Duties and Responsibilities:

Data Architecture & Engineering

Design, develop, and optimize complex data pipelines and transformation workflows using Azure Data Factory, Data Lake, Blob Storage, and Databricks.

Champion best practices for data modeling, data quality, performance tuning, and scalability in a cloud-native environment.

Partner with the Engineering Manager to drive technical decision-making for the architecture and maintenance of the centralized data warehouse used across operations, analytics, and public-facing platforms.

Quality, Security & Governance

Build and manage automated testing frameworks that support CI/CD pipelines and improve deployment reliability.

Work closely across teams to enforce data governance and data classification policies, including compliance with HIPAA standards for healthcare data.

Collaborate with internal and external IT teams to resolve data quality issues and ensure accurate, timely data availability.

Mentorship & Collaboration

Mentor junior data engineers through code reviews, design discussions, and onboarding support.

Work closely with Analytics, Product, and Operations teams to understand data needs and translate business requirements into sustainable data solutions.

Contribute to team rituals that foster a culture of continuous learning and knowledge sharing.

Documentation & Enablement

Create and maintain high-quality documentation including data dictionaries, schemas, ETL workflows, and quick-start guides.

Design APIs and reusable data assets that power analytical tools and public-facing applications.

Qualifications & Core Competencies

Required

Bachelor’s degree in Computer Science, Engineering, or a related field.

5+ years of hands-on experience in data engineering, including recent work in Azure environments.

Advanced proficiency in SQL and Python for data wrangling, transformation, and performance optimization.

Strong experience with Azure Data Factory, Azure Data Lake, Blob Storage, and Databricks.

Prior experience with healthcare claims data or other large, complex datasets.

Experience delivering enterprise-level, data-driven projects and collaborating effectively with cross-functional teams.

Familiarity with CI/CD practices, version control (e.g., Git), and automated testing of data pipelines.

Knowledge of handling JSON, XML, and other non-relational data formats.

Preferred

Master’s degree preferred.

Experience working in a mission-driven, data-mature organization.

Familiarity with tools like Azure AI, R, and data visualization platforms is a plus.

Experience contributing to or leading data architecture decisions for scalable cloud solutions.

Why Join Us

At 32BJ Health Fund, your work directly improves access to affordable healthcare for working families. As a Senior Azure Data Engineer, you will have the opportunity to shape the foundation of a growing data platform, influence key architectural decisions, and contribute to a collaborative team culture built on equity, transparency, and impact.

Please take a moment to watch our video to learn more about our culture and contributions to our members: youtu.be/hYNdMGLn19A

Also, visit our 32BJ Health Fund Funds Insight page: 32bjhealthfundinsights.org

Full-time