Azure Data Engineer

Job Description

AAC is seeking an Azure Data Engineer to join their reputable client in Downtown Greenville, SC. This is a growing organization with exciting initiatives in the data space as they continue to modernize their data strategies within Azure and Snowflake. You will be supporting the Database Operations team working alongside their Enterprise Architect.

** This position will be fully on-site in our client's beautiful new HQ building, downtown Greenville, SC. **

JOB FUNCTIONS

Design, implement, and support on-premises and cloud-based data infrastructure

Design and implement data acquisition, curation and consumption pipelines using Azure and Snowflake

Migrate on-premises data stores to the Azure cloud

Optimize and expand data pipelines for performance and scalability

Monitor and troubleshoot data pipelines within Azure Synapse

Participate in designing and building Azure data platforms supporting both batch and real-time (event-based) architecture

Collaborate with data scientists to design and implement machine learning models using Azure Synapse and Azure Machine Learning

Be knowledge in the technology stack available in the industry for metadata management, including Data Governance, Data Quality, MDM, Lineage, and Data Catalog

EDUCATION AND EXPERIENCE REQUIREMENTS

Bachelor’s degree in Computer Science or a related discipline preferred, or equivalent education/professional work experience

At least 4 years of hands-on experience in a data engineering capacity

Experience with designing data lakes and data warehouses using cloud technologies

Experience with Azure Synapse pipelines

Experience with SQL Server Integration Services (SSIS)

Strong knowledge of medallion architecture (Bronze, Silver, Gold stack)

Familiarity of Snowflake data cloud platform

Experience designing, building, and maintaining ETL/ELT data pipelines

Experience working with large datasets, data lakes, and big data technologies

Experience with leveraging, designing, and building database schemas on SQL Server

Familiarity with metadata management tools and practices

Understanding of data and query optimization, and query performance monitoring tools and techniques

Experience working in an agile development environment

Demonstrates strong communication and interpersonal skills. Demonstrates the ability, desire, and focus to meet deadlines

Excellent problem-solving skills and attention to detail

Ability to work independently and as part of a team

PREFERRED REQUIREMENTS

Technical training and certifications related to the role are highly preferred

Hands on experience with Snowflake

Experience with Python and Spark, Azure Logic Apps, Machine Learning, and Data Bricks

Experience with cloud infrastructure services such as Azure AD, Azure Kubernetes, Azure Networking, Azure Virtual Machines, and Azure Security

Hands on experience with implementing analytics solutions using Azure cloud technologies, including Azure ADLS Gen 2, Azure Data Factory, and Azure SQL Database

Experience using Git and Azure DevOps pipelines for deployment automation of data solutions

Company Description

Advanced Automation Consulting, Inc., headquartered in Columbia, SC, is an IT Consulting Services firm focused on the long-term success of our clients and consultants. At AAC, we never lose our intense, passionate focus on the needs of our clients. We attract and retain the best and brightest consultants and provide them with support, training, and the project discipline to ensure the success of our clients and AAC.

We operate at the highest level of integrity at all times, strive to be the *Best of the Best* in all that we do, and we are the Best Value service provider to our clients.