The Data Engineer II will independently support Northwest Bank cloud data operations, functions, pipelines and architectures. The incumbent will be responsible for adding new data sources to the existing Data Lake, incorporating data from the Date Lake into Azure Synapse, migrating existing on-premises SQL Server EDW and CECL to Azure Synapse, and activating the Azure Analytics engine to help analysts and data scientists gain deeper insights into customer and bank data.
After gaining an understanding of critical business objectives, the incumbent will determine the optimal design of Synapse, work with business partners on the initial use cases to implement, and work with business partners to drive the outcome.
In addition, the incumbent will deliver self-service access and use of the Data Lake to business partners, and ensure the business partners become independent in their use of Data by leveraging Power BI. During this journey, the Data Engineer will work with business partners on their use cases, engage with Data Analysts to develop new requirements, and constantly promote and support increased use of Data at Northwest.
Additional responsibilities may include designing and implementing changes to existing data pipelines, designing ETL processes, implementing advanced use cases, using machine learning to support growing digital channels, and monitor/tune the data environment for optimal performance. The incumbent will also participate in demonstrating value of our data assets and/or demonstrating/POC new ideas to move forward with our business partners.
Essential Functions
* Engage with business partners to define Azure Synapse use cases to be supported in migration to Azure Synapse
* Deploy Data Lake to business units and provide direct support for their use cases
* Manage and monitor business user Data Lake use cases for successful outcomes; assist business users in leveraging and capitalizing on these outcomes
* Migrate existing Data Lake data to Azure Synapse (will work with an offshore team)
* Migrate existing on-premises SQL Server EDW to Azure Synapse
* Design, build and optimize data pipelines from operational data stores to points of consumption (e.g. business stakeholders are constantly requesting new data ingestion, and need to deliver the data in a way to be consumed rapidly by business users)
* Assist business and technology stakeholders in the use of tools and data to drive higher automation rates, and thereby greater efficiency in Bank operations - automate most common, repeatable tasks to assist business partners in delivering value to customers; automate common IT functions using data to simplify IT operations; automate collections conversion by use of data to drive behavioral score carding
* Assist Data Governance team in delivering on Data Quality initiatives; and improve data capture at source points
* Collaborate with stakeholders to ensure that data requirements are appropriately documented, refined and satisfied by the team (Must be able to use JIRA and Confluence)
* Tune and manage Azure data environment
* Follow data and analytics security requirements and solutions, and work with management to manage risks and ensure confidentiality, integrity and availability of enterprise data and analytics assets
* Assist in defining modeling standards, guidelines, best practices and approved modeling techniques
* Train business users to access Data Lake and create visuals through Power BI
Additional Essential Functions
* Ensure compliance with Northwest's policies and procedures, and Federal/State regulations
* Navigate Microsoft Office Software, computer applications, and software specific to the department in order to maximize technology tools and gain efficiency
* Work as part of a team
* Work with on-site equipment
Additional Responsibilities
* Handle other projects on request
* Focus on