Data Engineer

Skill Set 1: NiFi, Snowflake, SQL, SQLServer, Python, understanding of Critical Mfg (5 resources) skills highlighted in yellow in mandatory .

Must Have Skills In

Develop ETL/ELT processing using Apache Ni-Fi

Strong background on SQL and databases (Snowflake, SQL, SQL Server)

Programming Skills: Python or Scala, C#

Data Analysis And Validation Skills

5+ years of relevant experience required.

Only BE/BTech, BCA, BSc, ME, MTech, MCA, MSc

Job Description Summary

As a Data Engineer, you will be a key member of a multi-functional team responsible for developing and growing systems for extracting new insight for our expanding data streams. You will be collaborating with data scientists, engineers, technicians, and data mining teams to design and implement systems to extract data from business systems, transforming it into an actionable format, and as needed, creating dynamic presentation layers for use by high-level engineers and managers throughout the company. You will be creating new solutions, as well as, supporting, configuring, and improving existing solutions.

Broad Knowledge And Experience In

Understanding of Big Data Engineering/processing, Business Intelligence, and Advanced Analytics

Developing ETL/ELT processes

Knowledge of databases and Data warehouse modeling

Knowledge in Cloud-based data engineering and Machine Learning Models

Knowledge of building APIs for application integration

Experience with various frameworks and processes, such as Agile

Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model

Work with Data Scientists to implement strategies for cleaning and preparing data for analysis, develop data imputation algorithms, and optimize the performance of big data and machine learning systems.

Full time