Lead Java PySpark Developer

Job Description

Job Title: Lead Java + PySpark Developer

Location: Dallas TX, Pittsburgh PA, Cleveland OH

Job Summary:

Incedo is seeking a skilled and experienced Java + PySpark Developer to join its data engineering team. The ideal candidate will work on scalable data pipeline development, data integration, and backend microservices, contributing to analytics and business insights platforms.

Key Responsibilities:

Design, develop, and maintain scalable data processing pipelines using PySpark on big data platforms like Hadoop or Databricks.

Build and enhance Java-based microservices/APIs to support data ingestion and transformation.

Collaborate with data scientists, data analysts, and architects to deliver high-quality, secure, and performant solutions.

Optimize data workflows and troubleshoot performance bottlenecks.

Participate in code reviews, design discussions, and provide technical leadership when needed.

Implement data validation, quality checks, and error-handling mechanisms.

Ensure adherence to data security and compliance standards within financial environments

Full-time