Senior Data Engineer

Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.

What are we looking for?

In this position, the individual is responsible for maintaining the company’s existing data pipelines, models, reports, and dashboards and implementing new ones based on the requirements of various projects. He/she is also responsible for working on various company local and regional data projects.

What are we expecting from this role?

Implement data replication from various source systems using various database technology (DB2, PosgresSQL, MongoDB, CouchDB) to centralized reporting database.

Implement and maintain various data monitoring and validation such as duplicate check, record tally check and data integrity validation.

Implement real-time Change Data Capture (CDC) data pipeline.

Design and develop data mapping, data modelling, and data aggregation to provide simplified and comprehensive data for report/dashboard/data set implementation.

Design and develop data for performance metric and MI needed for data visualization and dashboard design.

Design and develop complex report/dashboard/metric data model/script for data analyst/scientist.

Support and maintain Company’s Enterprise Data Warehouse.

Contribute and maintain all company related data documentations such as data dictionary, data definition and data input business process.

Identifying business information needs for an enterprise data warehouse and related reporting structures and interfaces.

Ensure continuous improvement and enhancement of company data management framework to comply with group data policies.

Identifying business information needs for an enterprise data warehouse and related reporting structures and interfaces.

Provide data-related consultation and solution analysis to business stakeholders and work with IT to ensure solution delivery meets data requirement.

Guide and provide on-the-job training to junior data engineers member.

Who are we looking for?

Bachelor’s degree in computer science / engineering with a business degree is a bonus. Or any data engineering related degree.

Experience implementing and maintaining Data Warehouse/Reporting Database in Microsoft Azure Cloud technology stacks using Databricks or Azure Data Factory.

Experience in developing and maintaining data replication and real-time data replication (CDC) using SQL Server Integration Services (SSIS).

Experience in handling basic database administration. Storage, index, deadlock, user security maintenance.

Experience in performing similar technical role such as system analyst, software engineer,

Experience in life insurance business and IT solution delivery to the business.

Experience in software development cycle business and functional documentation.

Experience in conceptual and functional business process modeling.

Bonus

Industry domain knowledge i.e. life insurance.

Experience in insurance policy administration (e.g. LIFE/Asia, Integral Life) system support, usage, configuration, and consultancy is a bonus.

Experience with DBMS technology (SQL, NoSQL, NewSQL), Big Data, data semantics, and data analysis.

Knowledge/Skill:

Database Knowledge: Azure SQL, DB2, PosgreSQL, MongoDB

Data documentation: data dictionary, data lineage, data flow diagram.

SQL Server Integration Services (SSIS)

Enterprise Data Warehouse ETL & CDC

Azure Databricks/Azure Data Factory with CICD deployment model

Advanced SQL, Advanced Excel

Database Maintenance Administration

Bitbucket (or Github), Visual Studio Code, Azure Data Studio

Jira and Confluence

Microsoft PowerBI

Core Competencies

Critical and analytical thinking

Effective communication (English)

Attention to detail (needed in validating and verifying data correctness.)

Specific Job Competencies

System/application design and architecture

Technical research

Quick learner in technical domain

Data structure design

Data Intelligence

Experience with multiple coding languages.

Business domain knowledge

Resourcefulness

Problem solving

Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.

24020132