Azure Data Lake Principal Architect

Job Description

The candidate needs to have experience doing solution architecture on Azure.

The Architect will play a crucial role in designing, developing, and maintaining our data infrastructure and platform integration solutions. Responsible for advancing our data engineering capabilities, ensuring data quality, and contributing to the success of data-driven initiatives. Candidate needs to have experience doing solution architecture on Azure. The company has a mature data platform currently and Architect will be responsible for all new designs moving forward.

Qualifications:

- Bachelor's or Master's degree in Computer Science, Information Technology, or related fields; or comparable work experience

- 8+ years of related professional experience including 5+ years in data lake development in large reporting environment(s)

- Expert in Azure cloud computing, specializing in Azure data engineering stacks like ADF (Azure Data Factory), ADLS, Event Hubs, Snowflake, Databricks, streaming, Azure PowerShell, and Log Analytics.

- Hands-on development experience with Design and Architecture of big data frameworks/tools: Azure Data Lake, Snowflake, Azure Data Bricks.

- Expert experience with Hadoop based technology (e.g. Spark) and programming (Python, SQL, PySpark)

- Knowledgeable about cloud computing costs and performance and capable of providing ongoing suggestions for cost & performance optimization.

- Solid understanding of Snowflake computing, including its integration with Azure Data Lake, utilizing ADLS as a source for data processing.