Senior Aws Data Lake Developer
This is NOT a C2C Position
Contract to Hire
Troy, MI
We are actively seeking a hands-on data engineer who possesses a strong passion for designing, optimizing, refactoring, and upgrading complex data solutions and who can help us design, develop and model Data Lakes within AWS.
Required Experience (Must Have)
Expert Python Developer (Minimum Two Years of Experience)
Strong AWS Experience (Minimum Three Years of Experience)
Demonstrated Data Lake Experience (with S3 as Storage)
Expert Lambda Developer
Expert in Fargate / Containers o Expert in Step Functions / State Machines o Expert in Cloud Formation
Experience with Semi-Structured Data
o XML, CSV, Parquet
Experience with Larger Data Pipelines (Multiple Terabytes)
Experience with Linux
Strong Automation Experience Helpful Experience
(Nice to Have)
Experience with AWS Glue / Spark
Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
Experience with Git and Azure DevOps
Experience with Relational Databases
Experience with Neo4j
Experience with Kettle and/or Apache Hop
Experience with Automotive Data / Industry
Experience with Agile / Scrum Primary
Responsibilities
Analyze large, and complex, data sets
Design, develop and coordinate the generation of Data Pipelines
Model complex data sets
Work collaboratively with team to plan and solve complex problems
Design for, or optimize existing pipelines, for performance
If you think this position is a good fit, please reach out to me - feel free to call, text, e-mail, or apply to this posting!
Brett Middleton