Data Engineer

Agility Partners is seeking qualified applicants to fill an open Data Engineer position for one of the largest utility companies in the United States, serving approximately 4 million customers. This is an exciting opportunity to work for a company whose mission is to deliver safe, reliable energy that drives value to their customers. You will be working on a team that supports corporate application integration.

• Create and maintain the data ingestion, quality testing and audit framework

• Build and automate the data ingestion, transformation and aggregation pipelines using Azure Data Factory, Databricks / Spark, Snowflake, Kafka

• Setup and continuously improve the data quality and audit monitoring as well as alerting

• Constantly evaluate the process automation options and collaborate with engineering as well as architecture to review the proposed design.

• Demonstrate mastery of build and release engineering principles and methodologies including source control, branch management, build and smoke testing, archiving and retention practices

• Adhere to and enhance and document the design principles, best practices by collaborating with Solution and in some cases Enterprise Architects

• Respond SLA driven production data quality or pipeline issues

• Work in a fast-paced Agile/Scrum environment

• Document the Data Flow Diagrams, Data Models, Technical Data Mapping and Production Support Information for Data Pipelines

The Perfect Candidate:

The ideal candidate would bring the following:

• Bachelor’s degree in Computer Science or Engineering or Mathematics or related field and 5+ years of experience in various cloud technologies within a large-scale organization

• 6+ years of experience in an Enterprise Data Management or Data Engineering role

• 3+ of hands on experience in building data pipelines using Azure Data Factory, Databricks / Spark for Cloud Datalake

• 5+ years hands on experience with using one or more of the following for data analysis and wrangling Databricks, Python / PySpark, etc.

• Expert level SQL knowledge on databases such as but not limited to Snowflake, Netezza, Oracle, Sql Server, MySQL, Teradata

• Experience with platform infrastructure and ability to deploy and support pipelines in production

Reasons to Love It:

This is a great opportunity to join an organization where people are at the center of everything they do and continue to be a top priority as they shift to a greener, more sustainable energy supply. As they look towards the energy future, they must ensure no one is left behind, this includes their employees, partners, customer and the communities they serve.

• Onsite 2-3 days/week in Columbus, OH

• Opportunity to be a part of a team that is focused on code quality and best practices

• Medical, Dental and Vision Insurance

• 401(k)

• Life Insurance

• Disability coverage