Framework Engineer - Azure Data Factory

Requirements:

Hands on experience with Azure data platform stack: Azure Databricks, Azure Data Factory, Azure Data Lake storage, Azure DevOps, Azure Functions

8+ years of experience developing enterprise big data solutions

Azure Data Engineer who can design the frameworks for data pipelines from Scratch.

5+ years of experience working Microsoft Azure data platform and an excellent grasp of the following:

Azure Cloud Services

• Development of Complex Data Ingestion & Transformation Pipelines

• Advanced SQL Programming

• Azure Data Factory

• Azure Data Lake Storage

• Azure Synapse Analytics or Azure Databricks

• SFTP

• Snowflake experience is a plus

• Kafka experience is a plus

• Retail experience is a plus

Experience with designing and building end-to-end pipelines

Experience in Azure DevOps CI/CD Stories, Bugs, and Issue management

Strong experience in shell scripting is required.

Strong ETL knowledge

Ability to build pipelines to process structured and semi-structured data.

Ability to work with in an agile team