PySpark Engineer

Job Description

Looking for a PySpark developer to support a backend development team focused on middleware and backend services.

Clearance Requirement : TS/SCI with Polygraph

Required Qualifications

Demonstrated experience utilizing big data technologies such as SPARK or PYSPARK.

Demonstrated hands on experience in Solr or Elastic such as running an index, spinning up a Solr cluster and loading an index onto the cluster, and/or making Solr/Elastic schema changes, etc.

Demonstrated experience performing data quality analysis.

Demonstrated experience with Regular Expressions (RegEx).

Demonstrated experience programming using languages such as Java, JavaScript, Bash, and Python.

Demonstrated experience working with several AWS services.

Demonstrated experience writing Java 8+ (we will be upgrading to Java 17 later this year)

Demonstrated experience with JIRA and GITHUB.

Demonstrated experience with Spring Boot and RESTful APIs

Demonstrated experience with Linux operating systems such as CENTOS.

Demonstrating experience designing, developing, and deploying middleware and/or backend code to a production system

Why Work at M1?

Engage in meaningful, mission-oriented work with national impact

Collaborate with top-tier professionals in a high-performance environment

Work on cutting-edge projects with the latest technology

Enjoy a culture of innovation, integrity, and technical excellence

M1 Technology is an equal opportunity employer and values diversity. We do not discriminate in hiring on the basis of race, color, religion, sex, national origin, age, disability, veteran status, or any other characteristic protected by federal, state, or local law.

Full-time