Data Engineer

Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.

We are looking for a collaborative and resourceful Data Engineer/ETL Developer. You are dedicated, naturally inquisitive and are comfortable in a fast-paced environment.

This role will be part of and a member of our Data Delivery Group, you will be responsible for analysis, design and implementation in high-performing, experienced team. You'll be required to apply your depth of knowledge and expertise to all many areas including requirements, infrastructure, and solutioning. Aviva has embarked on an exciting journey to modernize, craft and build a next generation of data platform to support the growing data needs for data engineering, analytics and Data Science.

We embrace a culture challenging the status quo and constantly look to efficiently simplify processes, technology, and workflow.

This position reports to the AVP – Data Delivery.

What you’ll do

Design and Develop ETL Pipeline to ingest data into Hadoop from different data sources (Files, Mainframe, Relational Sources, NoSQL Etc.) using Informatica BDM

Parse unstructured data, semi structured data such as JSON, XML etc. using Informatica Data Processor.

Analyze the Informatica PowerCenter Jobs and redesign and develop them in BDM.

Design and develop efficient Mapping and workflows to load data to Data Marts.

Perform the GAP analysis between various legacy applications to migrate them to newer platforms/data marts.

Write efficient queries in Hive or Impala and PostgreSQL to extract data on Adhoc basis to do the data analysis.

Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.

Work with Hadoop administrators, Postgres DBAs to partition the hive tables, refresh metadata and various other activities, to enhance the performance of data loading and extraction.

Performance tuning of ETL mappings and queries.

Write simple or medium complex shell scripts to preprocess the files, schedule ETL jobs etc.

Identify various manual processes, queries etc. in the Data and BI areas, design and develop ETL Jobs to automate them.

Participate in daily scrums; work with vendor partners, QA team and business users in various stages of development cycle.

Advocate importance of data catalogs, data governance and data quality practices.

Outstanding problem solving skills

Work in an Agile delivery framework to evolve data models and solution designs to deliver value incrementally.

You are a self-starter with experience working in a fast-paced agile development environment.

What you’ll bring

University degree in Computer Engineering or Computer Science

3+ years of experience working on Informatica BDM platform.

Experience on various execution modes in BDM such Blaze, Spark, Hive, Native.

3+ years of experience working on Hadoop Platform, writing hive or impala queries.

5+ years of experience working on relational databases (Oracle, Teradata, PostgreSQL etc.) and writing SQL queries.

Should have deep knowledge on performance tuning of ETL Jobs, Hadoop Jobs, SQL’s, Partitioning, Indexing and various other techniques.

Experience in writing Shell scripts.

Experience in Spark Jobs (Python or Scala) is an asset.

Knowledge/experience in Cloud Data Lake Design – pref AWS technologies like S3, EMR, Redshift, Snowflake, could data catalog etc.,

Understanding of reporting/analytics tools (QlikSense, SAP Business Objects, SAS, DataIku, etc.,)

Familiar with the Agile software development

Excellent verbal and written communication skills

Insurance knowledge an asset-Ability to foundationally understand complex business process driving technical systems.

What you’ll get

Competitive rewards package including base compensation, eligibility for annual bonus, retirement savings, share plan, health benefits, personal wellness, and volunteer opportunities.

Exceptional Career Development opportunities.

We’ll support your professional development education.

Additional Information: Aviva Canada has an accommodation process in place to provide accommodations for employees with disabilities. If upon commencement of employment you require a specific accommodation because of a disability, please contact your Talent Acquisition Partner so that an appropriate accommodation can be arranged. This process applies throughout your career with Aviva Canada.