Software Engineer-Apache spark/Python/Big data

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!

Strategic Staffing Solutions is currently looking for a Software Engineer for a W2 contract opportunity with one of our largest clients!

Candidates should be willing to work on our W-2 ONLY, NO C2C

Job Title: Software Engineer -Big data

Role Type: W2 only

Duration: 12 months

Locations: Charlotte, NC

Work Authorization: USC/GC/H1B visa transfers only.

Seeking a Full stack engineer to join our team, with expertise in Cloud, Python/Spark. This role focuses on designing, deploying and managing scalable data processing solutions in a cloud-native environment. You will work closely with data scientists, software engineers, and DevOps team to ensure robust, high-performance data pipelines and analytics platforms.

Responsibilities:

• Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark

• Container Development: Design and implement docker images

• Optimization: Tune Spark jobs for performance, leveraging OpenShift's/Cloud resource management capabilities

• Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)

Experience:

o 3+ years working on Apache Spark for big data processing.

o 1+ years of Django and Airflow development experience.

o 1+ years of cloud development experience. (Google Cloud preferred)

Technical Skills:

• Proficiency in Spark frameworks(Python/PySpark)

• Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)

• Hands on working experience on distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS)

• Programming: Strong coding skills in Python, Airflow, Django; experience with shell scripting is a plus.

• Education: Bachelor's degree in Computer Science, Engineering or related filed.