Sr Data Engineer

Responsibilities:

Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights

Build the next generation Distributed Data Pipelines using programming languages like Python

Be part of a group of engineers building data pipelines using big data technologies (Spark, Snowflake, AWS Big Data Services like Glue) on medium to large scale datasets

Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

Collaborate with digital product managers, and deliver robust cloud-based solutions.

Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Preferred Skills:

AWS (EMR, EC2, Glue, Lambda, S3), Spark, Python, Databricks

3+ years of experience in application development including Python, SQL

2+ years of experience with a public cloud (AWS)

3+ years experience with Distributed data computing tools (Spark)

3+ years of experience with UNIX/Linux including basic commands and shell scripting

2+ years of experience with Agile engineering practices

Reason For Request: