Data Engineer

Hansen Talent Group is seeking a Data Engineer with strong AWS data warehousing experience a great data driven team! Candidates must be able to be onsite in Columbia, SC 1-2 days/week minimum.

The AWS Data Engineer will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery and production implementation

Duties:

Deliver digestible, contemporary and immediate data content to support and drive business decisions

Involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes

Review functional and technical designs to identify areas of risk and/or missing requirements

Create ETL processes using PySpark and Scala.

Build applications using Python, SQL, Databricks and AWS

Contribute to the exploration and understanding of new tools and techniques, and propose improvements to the data pipeline

Qualifications:

8+ years working with Large Data Lakes as a Data Engineer

Hands-on experience with AWS computational technologies, AWS storage, Spark, Scala, Python.