Data Engineer - GCP

Job Summary

The Senior Data Engineer will design, build, optimize, and support enterprise-scale data pipelines within a hybrid big data architecture, primarily on Google Cloud Platform (GCP). This role focuses on data ingestion, transformation, governance, and curation while ensuring performance, cost efficiency, security, and compliance with enterprise standards.

Role Descriptions / Responsibilities

Re-write and enhance existing data pipelines to meet evolving business needs.

Design and build production-grade data pipelines from ingestion to consumption in a hybrid big data environment.

Develop pipelines using Java, Python, GCP Dataflow, and Apache Airflow.

Design and implement Collibra workflows using Java.

Design and implement data ingestion, transformation, and curation solutions using GCP-native and custom frameworks.

Optimize data pipelines for performance, scalability, and cost efficiency across large-scale data lakes.

Ensure technical specifications align with business requirements and enterprise architecture standards.

Partner with external consultants, solution providers, and managed services teams to deliver compliant and scalable solutions.

Collaborate across multiple teams to track project progress, identify risks, and communicate status and impacts to leadership.

Proactively propose process, platform, and technical improvements.

Ensure platforms and tools meet data security, audit, and compliance requirements.

Apply best practices for frameworks, naming conventions, scripting, and coding standards.

Communicate technical concepts clearly to non-technical stakeholders. Essential Skills & Qualifications

Bachelor's degree or equivalent work experience.

8+ years of engineering experience in Big Data, Data Analytics, and Data Integration.

2+ years of hands-on experience in GCP Data Engineering and Cloud Analytics solutions.

5+ years of programming experience with:

Python

Java

Spring Boot, Spring MVC

REST API development

Hands-on experience with CI/CD pipelines (Concourse, Jenkins).

Experience with GCP Data Ingestion technologies:

Dataflow

Fusion

Airflow

Experience designing and optimizing data models using BigQuery.

Experience integrating KMS / HSM solutions with GCP data services.

Experience implementing metadata management solutions on GCP.

Strong verbal and written communication skills