Data Engineer

Candidate Must Hold Current Authorization To Work W2, Without The Need Of Future Sponsorship, Cannot Work C2C*** Agility Partners is seeking a qualified Data Engineer.

This is an exciting opportunity to utilize your skills in Data modeling and advanced SQL techniques.

This will give an engineer the opportunity to use their skills in cloud migration methodologies and processes.

Key Responsibilities: SQL, Python, Spark, Databricks,DBTWorking with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationDevOps process and Terraform scriptingLeadership skills: must be able to put together and deliver presentation.Acting as the lead on a data engineering team Qualifications: Experience in Data modeling and advanced SQL techniquesExperience working on cloud migration methodologies (AWS and Azure Preferred) Expert in SQL, Python, Spark, DatabricksExperience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformationExperience with DevOps process and understanding of Terraform scriptingUnderstanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database designExperience designing and implementing ingestion processes for unstructured and structured data setsExperience designing and developing data cleansing routines utilizing standard data operationsMinimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms.

Reasons to Love It Work within a collaborative team environment where ideas and creativity are welcomed!

Family and Work Life balance are important to this organization and valued for the employees.Working for an organization that focuses on company culture, inclusion and diversity50% medical coverage for you and your entire family, short/long term disability and life insurance options401(k)Life InsuranceDisability coverage