Data Engineer (Nutrition & Feed sphere)

Company Background

The client is the second-largest private company in the world. The customer specializes in creating food and feed formulation software. As part of the supply chain, they work with producers and customers to source, manufacture and deliver products that are vital to people's existence. The companies provide the essentials that enable businesses to grow, communities to prosper, and consumers to live well on a daily basis. The company has a long-term approach, leveraging 158 years of experience.

Project Description

The task is to move a large data collection, storage and processing system to a new architecture. The system is currently available and functioning in the customer's existing environment, however, a more elegant, suitable and modern architectural solution should be implemented and enhanced. Interaction with related systems and engagement with stakeholders are essential to the success of the project. You are expected to work on the project from scratch 80% of the time (new architecture), and 20% of the time you will support the existing architecture until the new one is implemented.

Technologies

Python

Scala

Java

PostgreSQL

Amazon Redshift

Data Warehousing

HDFS

Spark

Impala

Oozie

Hue

Amazon S3

AWS Lambda

AWS Step Functions

Amazon Redshift

Git

IntelliJ IDEA

Apache Airflow

Jenkins

What You'll Do

Work in a highly interactive, team-oriented environment;

Understand the products, services, and features;

Improve software platform using new tools, frameworks, and technologies;

Support users within the organization to organize their cloud ecosystems (several apps/projects);

Speak cross-discipline to determine where and what kind of toolset is needed most;

Communicate with different people located in Europe and Americas;

Job Requirements

4+ years' commercial experience working as a Data Engineer;

Experience working with Python (preferred), Scala, Java;

Experience working with AWS;

Level of English - from Upper-Intermediate (spoken/written);

What Do We Offer

The global benefits package includes:

Technical and non-technical training for professional and personal growth;

Internal conferences and meetups to learn from industry experts;

Support and mentorship from an experienced employee to help you professional grow and development;

Internal startup incubator;

Health insurance;

English courses;

Sports activities to promote a healthy lifestyle;

Flexible work options, including remote and hybrid opportunities;

Referral program for bringing in new talent;

Work anniversary program and additional vacation days.