GCP Data Engineer

Start Date: Interview Types

Skills GCP Data Engineer Visa Types H1B, Green Card, US ..

Job Description:

• Title - GCP Data Engineer

• Location: Charlotte, NC/ Iselin, NJ (Hybrid)

• Duration- Long term Contract

Job Summary

Role Responsibilities:

• Design, code, test, debug, and document technology solutions for complex projects and programs.

• Collaborate with key technical experts and senior technology teams to resolve complex technical challenges and meet project goals.

• Contribute to the development of Data Mesh capabilities to improve data accessibility across disparate platforms such as Hadoop, Teradata, and SQL Servers.

• Support Data Science functions by preparing pre-work required for data exploration and analysis.

• Support System Testing, User Acceptance Testing (UAT), and end-to-end testing activities; develop test automation for batch processes and APIs within a CI/CD environment.

• Work with Agile methodologies, writing user stories, and participating in Agile ceremonies.

Required Qualifications:

• 3-5 years' experience designing and delivering data solutions in Google Cloud Platform (GCP), leveraging services such as DataProc, DataFlow, BigQuery, and other GCP tools.

• Expertise in Big Data platforms using technologies like Spark, PySpark.

• Proficiency in event-driven solutions using Java, REST APIs, Python, Airflow (DAGs) and Kafka technologies.

• Strong familiarity with wire formats such as XML, JSON and CSV, along with serialization/deserialization techniques.

• Solid understanding of Agile methodologies and delivering in scrum teams, including productivity curves, writing user stories and participating in ceremonies such as daily standups, refinement, sprint planning and retrospectives.

Desirable Qualifications:

• Experience in Big Data platforms using technologies like MapR, Cloudera, HDFS, and Hive.

• Experience in event-driven solutions using Apache Flink.

• Experience with relational and NoSQL databases, including MongoDB, SQL Server, Atlas, and Azure SQL.

• Familiarity with wire formats such as Avro.

• Knowledge of security protocols (e.g., Kerberos, JWT) and their integration into data platforms and solutions.

Remote