Azure Data Engineer

Job Description

Job Summary:

Our client is seeking a Data Integration Specialist with experience in Azure, SQL, Microsoft Fabric, and data warehousing to support their growing team of developers. The ideal candidate will play a pivotal role in transitioning the acquired company’s systems to their platform, assisting with critical go-live phases and future initiatives. This position is integral to meeting project deadlines and ensuring a seamless migration from legacy integration tools to Microsoft Azure and Fabric-based platforms.

Responsibilities:

Design and Develop Integration Solutions

Create and implement integration workflows by understanding business requirements, data sources, and target systems.

Architect solutions that integrate Microsoft Fabric pipelines, Lakehouses, and OneLake storage with enterprise systems.

Build Data Integration Processes

Develop and configure ETL processes using Azure Data Factory (ADF) and Microsoft Fabric Data Pipelines to move and transform data between ERP systems, Medius, Workday, and other applications.

Use Dataflows Gen2 in Fabric for data ingestion and transformation.

Maintain Data Warehouse and Lakehouse Systems

Manage integration from ERP systems and other data sources into both traditional data warehouses and Fabric Lakehouses, ensuring timely and accurate data availability for analytics.

Ensure seamless flow of data into Power BI reports through integration with Microsoft Fabric datasets.

Implement EDI File Transmission

Configure integration systems to handle the transmission and transformation of EDI messages between trading partners, ensuring compliance with industry standards.

Integrate with Workday and Medius

Establish seamless data movement from Workday and Medius into Microsoft Fabric and Azure environments for effective AP automation and invoice processing.

Collaborate with Stakeholders

Work closely with business analysts, data architects, and system administrators to gather requirements and deliver scalable integration solutions.

Ensure Data Quality

Implement validation mechanisms across the data pipeline using Data Quality rules in Fabric to ensure data accuracy, consistency, and conformance with business rules.

Optimize Performance

Analyze performance of Fabric data pipelines and optimize for speed, cost-efficiency, and reliability.

Utilize Performance Analyzer tools in Power BI and Fabric Monitoring Hub for ongoing improvement.

Document and Report

Maintain detailed technical documentation of integration processes, mappings, configurations, and workflows.

Generate metadata and operational reports through Fabric Monitoring and Metrics dashboards.

Continuous Improvement

Stay current with the latest technologies in Microsoft Azure, Microsoft Fabric, Workday, Medius, and enterprise integration trends.

Qualifications:

Experience using Azure Data Factory, Azure SQL DB, Synapse, and Microsoft Fabric (Lakehouses, Pipelines, Dataflows Gen2, OneLake).

Heavy SQL experience including SSMS, SSIS, SSAS.

Strong understanding of integration technologies including REST/SOAP APIs, JSON, XML, and flat files.

Experience integrating with ERP and cloud-based applications (e.g., Workday, Medius).

Familiarity with event-driven architectures, Pub/Sub models, and data streaming platforms.

Working knowledge of relational databases like SQL Server, Oracle, or MySQL.

Excellent technical documentation, design, and collaboration skills.

#IND

#ZIP

#ZP

#ZRCompany Description

Thomas Edwards Group is an Executive Search Firm specializing in the direct hire and interim placement of Accounting, Finance, HR and IT professionals. We’ve been in business since 1997 and the Dallas Business Journal has ranked us a Top Search Firm in Dallas and one of the “Best Places to Work” multiple times. Thomas Edwards Group also made the Inc. 5000 list in 2016 and our award-winning team of Search Consultants, which rank among the best and most experienced in the area, includes MBAs, CPAs, former Big 4 Professionals, Controllers, IT Search Professionals, Finance/Banking, and Business Professionals.

Full-time