Databricks Developer - Java Spark

Job Description

About Our Company:

Delmock Technologies, Inc. (DTI), is a leading HUBZone business in Baltimore, known for delivering sophisticated IT (Information Technology) and Health solutions with a commitment to ethics, expertise, and superior service. Actively engaged in the local community, DTI creates opportunities for talented residents while maintaining a stellar reputation as an award-winning contractor, earning accolades like the Government Choice Award for IRS (Internal Revenue Service) Systems Modernizations.

Clearance: Active IRS MBI Clearance Required; IRS issued laptop strongly preferred.

Location: Remote.

Role:

Delmock Technologies, Inc. is seeking a Databricks Developer with deep expertise in Java and Apache Spark, along with hands-on experience working with IRS data systems such as IRMF, BMF, or IMF. The ideal candidate will be responsible for designing, developing, and optimizing big data pipelines and analytics solutions on the Databricks platform. This role requires a deep understanding of distributed data processing, performance tuning, and scalable architecture.

Responsibilities:

Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks

Implement data processing logic in Java 8+, leveraging functional programming and OOP best practices

Integrate with IRS data systems including IRMF, BMF, or IMF

Optimize Spark jobs for performance, reliability, and cost-efficiency

Collaborate with cross-functional teams to gather requirements and deliver data solutions

Ensure compliance with data security, privacy, and governance standards

Troubleshoot and debug production issues in distributed data environments

Minimum Requirements:

Bachelor’s degree in Computer Science, Information Systems, or a related field.

8+ years of professional experience demonstrating the required technical skills and responsibilities listed:

IRS Data Systems Experience

Hands-on experience working with IRS IRMF, BMF, or IMF datasets

Understanding of IRS data structures, compliance, and security protocols

Programming Language Proficiency

Strong expertise in Java 8 or higher

Experience with functional programming (Streams API, Lambdas)

Familiarity with object-oriented design patterns and best practices

Apache Spark

Proficient in Spark Core, Spark SQL, and DataFrame/Dataset APIs

Understanding of RDDs and when to use them

Experience with Spark Streaming or Structured Streaming

Skilled in performance tuning and Spark job optimization

Ability to use Spark UI for troubleshooting stages and tasks

Big Data Ecosystem

Familiarity with HDFS, Hive, or HBase

Experience integrating with Kafka, S3, or Azure Data Lake

Comfort with Parquet, Avro, or ORC file formats

Data Processing and ETL

Strong understanding of batch and real-time data processing paradigms

Experience building ETL pipelines with Spark

Proficient in data cleansing, transformation, and enrichment

DevOps / Deployment

Experience with YARN, Kubernetes, or EMR for Spark deployment

Familiarity with CI/CD tools like Jenkins or GitHub Actions

Monitoring experience with Grafana, Prometheus, Datadog, or Spark UI logs

Version Control & Build Tools

Proficient in Git

Experience with Maven or Gradle

Testing

Unit testing with JUnit or TestNG

Experience with Mockito or similar mocking frameworks

Data validation and regression testing for Spark jobs

Soft Skills / Engineering Practices

Experience working in Agile/Scrum environments

Strong documentation skills (Markdown, Confluence, etc.)

Ability to debug and troubleshoot production issues effectively

Preferred/Nice to Have Skills:

Experience with Scala or Python in Spark environments

Familiarity with Databricks or Google DataProc

Knowledge of Delta Lake or Apache Iceberg

Experience with data modeling and performance design for big data system

Recently ranked as high as #3 among HUBZone Companies in a GOVWIN survey, DTI offers a dynamic environment for those passionate about impactful projects, community involvement, and contributing to top-ranking Federal and State Commissionaires project support teams.

At DTI, we balance continuous growth and innovation with a strong dedication to corporate social responsibility. Join our talented team and be part of a company that values both professional excellence and community impact. Explore the exciting career opportunities awaiting you at DTI!

DTI is committed to hiring and maintaining a diverse workforce. We are an equal opportunity employer making decisions without regard to race, color, religion, sex, national origin, age, veteran status, disability, or any other protected class.

Hybrid remote