Big Data Engineer

Job Title: Big Data Engineer

Location: Columbus, OH

Type: W2 Contract/No C2C

Pay Rate:

Job Summary:

We are hiring a Big Data Engineer. You will build and optimize large-scale data systems. You will work with Spark, Hadoop, and cloud platforms.

Key Responsibilities:

Design and build big data pipelines using Spark and Hadoop

Tune Spark queries for performance

Write Spark SQL, streaming, and dataset APIs

Work with HDFS and Unix shell scripts

Build and support ETL/ELT processes

Integrate Spark with SQL Server and MongoDB

Use RDBMS like Oracle, MySQL, or SQL Server

Participate in Agile development teams

Required Qualifications:

7+ years in software engineering

3+ years with Spark and Hadoop

3+ years with Spark SQL and streaming

Strong skills in performance tuning Spark

Experience with cloud data platforms

Proficient in Unix shell scripting

3+ years with RDBMS and NoSQL databases

2+ years of Agile methodology

Preferred Skills:

Experience in enterprise-scale data environments

Familiar with cloud-native tools and solutions