Data Engineer

Job Summary:

Our client is seeking a Data Engineer who is highly enthusiastic and has experience in Python and Databricks. They will create, tune, maintain, and build reporting Big Data platforms that drive business.

Duties:

Perform systems integration design and development in cloud architecture design

Build sizing and cost models for Cloud Services

Review enhancement requests and recommend best solution to stakeholders as SME

Containerizing ingestion processes using docker and Kubernetes services

Understand business requirements to design, build, develop and test data integration pipelines

Plan, direct DevOps implementation and system hardware and software updates for better performance, stability

Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day

Desired Skills/Experience:

Bachelor’s Degree in Computer Science or equivalent

5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix

2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure)

1+ years experience with GCP and Azure Cloud Big Data tools (PowerBI/DataLake/ Azure Databricks)

Self-motivated with excellent analytical, problem solving, verbal and communication skills

Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc.

Basic knowledge of using Devops, Github, JIRA tools and ability to work in agile environment

Benefits:

Medical, Dental, & Vision Insurance Plans

401K offered