Senior Java Spark Developer - Hybrid Locals to TX or CA

Title: Senior Java Spark Developer - Hybrid Locals to TX or CA

Location: Austin, TX, USA/Sunnyvale, CA

Length: Long term

Restriction: W2 or C2C

Description:

Webcam interview *** Long term project *** ***Hybrid***

Description:

Job Description:

Looking for a Senior Java Spark Developer with deep expertise in Cloudera ecosystem and distributed computing. The role requires hands-on experience in Spark optimization, data engineering, and microservices development.

Key Responsibilities:

Spark & Java Development:

Develop and deploy Java-based Spark applications.

Optimize Spark jobs and develop APIs/microservices.

Big Data Ecosystem:

Integrate with Cloudera components: HDFS, Hive, HBase, Impala.

Handle high-scale data ingestion with Kafka, Flume, and Sqoop.

Collaboration & CI/CD:

Work with cross-functional teams on data processing and architecture.

Use Jenkins, GitLab for version control and pipeline automation.

Performance & Tuning:

Troubleshoot and fine-tune Spark applications.

Ensure scalability and reliability of data systems.

Project Environment:

Languages: Java, SQL

Big Data: Spark, Cloudera Hadoop (CDH)

Messaging: Kafka, Flume

Orchestration: Oozie, Nifi

CI/CD: Git, Jenkins, GitLab

Databases: HBase, Hive, PostgreSQL

Required Skills & Qualifications:

8+ years in application and data engineering.

Expertise in Java and Apache Spark.

Strong knowledge of Cloudera ecosystem and real-time data streaming.

Experience with CI/CD pipelines and microservices.