Big Data Engineer

Job Description

Location: Hybrid to Atlanta, GA

Duration: 6+ Months to extend

Rate: $90-100 Per Hour W2

Start Date: ASAP

Responsibilities:

Architecture and Design

Code Development

Production Support

Mentoring of junior team members

Automation Requirements:

Bachelor's in computer science or closely related discipline.

High level of experience with Spark Steaming

4+ years of focused experience in Big Data space.

Highly experienced with Scala and either Python or Java

Experience building data processing pipelines at scale on AWS.

Experience in AWS components like EMR, EC2, ECS and Redshift

Deep understanding of the concepts involved with managing resources in AWS.

Experience working with different file formats like Avro, Json, Parquet Nice to Haves:

Experience in Rest based microservice architecture

Ability to lead new and complex projects having multiple dependencies from design phase all the way to production. This may involve facilitating across multiple teams.

Nice to have experience in Airflow and Jenkins or other CI/CD.

Nice to have experience on different monitoring, alerting, dashboarding tools like Datadog and PagerDuty.

Nice to have dev ops experience with focus on cloud formation and terraform

Other skills needed to perform the job (ex: presentation skills, negotiation skills, etc.).