Data Integration Engineer

Job Description

***Must be located within an hour of the following cities by car***

***Must be a US citizen or GC holder***

NO THIRD PARTIES PLEASE

Atlanta

Austin

Chicago

Cincinnati

Cleveland

Columbus

Dallas

Denver

Houston

Los Angeles

New York

Costa Mesa

Orlando

Philadelphia

San Francisco

Seattle

Washington DC

Wilmington

RESPONSIBILITIES:

• Develop and implement data processing workflows/pipelines to support solutions development and business intelligence needs.

• Ensure seamless flow of data across systems by developing scalable and effective data integration solutions.

• Use big data technologies like Azure Data Lake, Synapse Analytics, and Data Factory to handle and analyze large volumes of data.

• Leverage Microsoft Fabric to integrate data engineering, data science, real-time analytics, and business intelligence within a single SaaS platform.

• Support the Enterprise Data Model by managing the medallion architecture layers in the data lake, keeping data sources current and integrating new data.

• Develop and maintain data storage solutions, including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

• Implement data validation and cleansing procedures to ensure the highest level of data quality and integrity.

• Develop and integrate intelligent chatbots and copilots powered by Azure OpenAI services to extract meaningful insights from unstructured data (e.g., documents, emails) and structured enterprise data, all unified within the Enterprise Data Model (EDM) in the data lake.

• Build and maintain low-code and no-code data workflows using Microsoft Power Platform and Logic Apps to support app development by enabling rapid data collection, integration, and transformation from various sources into centralized data platforms.

• Work together with cross-functional teams to understand the needs for data and create effective data workflows.

REQUIRED TECHNICAL SKILLS: Proficiency in the following tools and technologies:

• Azure Data Factory, Azure SQL Database, Azure Blob Storage, Azure Data Lake Storage

• Azure Synapse Analytics, Azure Databricks, Apache Spark, Apache Airflow

• Azure Logic Apps, Azure DevOps, Power Automate, REST API

• Microsoft Fabric (including Lakehouse, Data Engineering, and Real-Time Analytics)

• Medallion architecture design patterns using Delta Lake (bronze, silver, gold layers)

• Azure OpenAI for embedding AI-powered features like GPT, embeddings, and document intelligence into data platforms

• Microsoft Power Platform (Power Apps, Power Automate, Power BI) for low-code data integration and automation

• Version control and CI/CD practices for data workflows using Azure DevOps and Git

REQUIRED EDUCATION AND EXPERIENCE:

1. Bachelor’s degree in computer science or information technology

2. 8-10 years of hands-on experience developing software solutions

Full-time