Sr. Data Engineer

Robert Half is looking for a Data Engineer role that is pivotal within the Business Intelligence and Data Warehousing team, serving as a software engineering expert. This individual is tasked with developing robust data ingestion systems to facilitate the creation of high-value business intelligence products. As an individual contributor, this role emphasizes hands-on development and adept problem-solving abilities for addressing production support issues.

Experience Required: 8+ years of engineering experience, with a demonstrated track record of working extensively with Azure Data Factory and Informatica Power Center / IICS.

Responsibilities:

Designing, implementing, and optimizing data integration solutions utilizing Microsoft Azure services and other relevant tools.

Automating tasks and deploying production-grade code with a focus on unit testing, continuous integration, version control, etc.

Creating and maintaining data pipelines using Azure Data Factory.

Collaborating within an Agile framework to deliver timely and effective solutions.

Taking primary responsibility for production support activities, with secondary support provided by others.

Adapting and learning new tools as necessary to meet evolving business requirements.

Required Skills:

Extensive recent experience as an Azure Data Engineer, complemented by prior exposure to either Informatica IICS or Power Center.

Proficiency in Cloud Application Integration and Cloud Data Integration utilizing Azure Data Factory, Azure Functions, and Serverless architecture.

Solid understanding of Rest V2, Swagger file generation, and proficiency in Python scripting.

Hands-on experience in developing application integrations using SOAP/REST APIs and familiarity with big data technologies such as Apache Spark.

Familiarity with DevOps platforms, including Azure DevOps and GitHub.

Preferred Skills:

Familiarity with Kubernetes, Docker, Terraform, and/or Snowflake.

Working knowledge of SQL and proficiency in data analysis techniques.