Data Engineer

Job Description:

We are searching for a Lead Data Engineer to implement data engineering and analytics solutions.

Primary responsibilities include full implementation and maintenance of data ingestion, data maintenance, data validation and data delivery of investment data.

We are looking for someone who thrives in an agile, collaborative, team-based environment, working closely with technology peers across the organization, investment professionals and key vendor partners.

PRINCIPAL RESPONSIBILITIES:

Design, develop, and implement data pipelines to maintain unified data platform for the Investment Data Management Office(IDMO)

Lead and participate in all development activities, develop and implement solutions to meet business requirements that align with program strategic objectives

Responsible for new and on-going development of data pipelines sourcing from internal and external sources

Drive continuous improvement of data quality, resiliency, control, efficiency, and monitoring

Troubleshooting complex system interactions to find the root cause to problems

Partner with platform lead to design, develop, implement and deploy new software components to investment data platform

Partner with data architect to evaluate and finalize the unified data model

Partner with integration architect to upgrade and integrate data ingestion and data delivery tools with the unified data platform

Upgrade and integrate transformation tool, data validation tool and orchestration tools with the unified data platform to implement data engineering, analytical engineering and data maintenance capabilities.

Provide support during unexpected outages

JOB REQUIREMENTS:

Bachelor’s degree in Computer Science or related disciplines.

Minimum of 5 years of experience in design, development and building data oriented complex applications.

Minimum of 2-4 years of hands-on progressive experience from SQL to Advanced SQL.

Experience working in data integration (ETL/ELT), data warehouse, data analytics architecture and sound understanding of design principles.

Knowledge of and experience with Snowflake and other cloud native databases is highly preferred.

Development Experience in Cloud based PAAS platforms like Microsoft Azure, Google GCP or Amazon AWS

Deep understanding of Agile SDLC, DevOps and Cloud technologies required, in addition to exposure to multiple, diverse technologies, platforms, and processing environments.

Knowledge about various architectures, patterns such as unified data management architecture (UDM), data mesh architecture, event-driven architecture, real-time data flows, non-relational repositories, data virtualization, etc.

Experience with building solutions in the financial services domain with an understanding of financial instruments, transactions, and positions, is desired.

Good interpersonal and communication skills with the ability to lead cross-team collaboration and partnerships across a variety of internal and external constituencies.