Post Job Free
Sign in

Data Engineer III

Company:
SIXT Research & Development India
Location:
Bengaluru, Karnataka, India
Posted:
April 21, 2024
Apply

Description:

Job Description

THE CHALLENGE:

The Central Business Intelligence team builds and maintains the SIXT Data Platform and its Data Catalogue, servicing thousands of users at a global scale. Our main product, the SIXT Data shop, collects tens of millions of events daily, processes them according to our consumer’s needs, and services them via a toolbox ranging from self-service batch processes to real-time ML model endpoints. Our main challenges currently include better automation of our operations, increased self-service capabilities (for ingestion, ETLs, and distribution), and enabling new use-cases for our customers. Our team, which consists of 15 team members (Data Engineers and Business Intelligence Engineers), is hands-on and constantly dives into the latest technology releases. SIXT stands for success, agility, ownership, and an intercultural team.

What you’ll do? – Perform as smoothly as our cars:

You develop the end-to-end automation of data pipelines to make ingestion, transformation, and distribution of data more efficient and self-service for our users

You explore and learn the latest AWS and big data technologies to uncover hidden use-cases, enable new capabilities, and build new integrations for our SIXT Data shop product

You interact with Data Engineers, BI Analysts and Data Scientists to find the best solutions for different analytical use cases (Dashboarding, ad hoc Analytics, Data-as-a-product, Machine Learning)

You contribute to the Data Platform vision and execution with experience, new ideas, and your own curiosity.

You show extreme work ethics and integrity to deal with sensitive data while protecting our end-customer

Qualifications

What do you need to succeed? – Your willingness to accelerate:

You hold a bachelor’s or master’s degree in computer science or related fields preferred

You have relevant experience of 6+ years.

You have got experience with combined Data Lake and Data Warehouse architectures and automation from data sources to analytical dashboards with ELT

You are experienced in analytical cloud datawarehouses (Redshift/Snowflake) & you know how to create transformed data models (dbt) and to automate interdependent jobs (Apache Airflow)

You are experienced in working with AWS services in CLI and Console (S3, EC2, EMR, Lambda, Kinesis, IAM...) and infrastructure as code (Terraform, CloudFormation)

You work with engineering best practices across the development lifecycle, including agile methodologies, code reviews, source management (GitHub), deployment processes (Jenkins), testing, operations, etc. and you also have got an understanding of data management fundamentals, distributed systems, and data storage/compute principles

Knowing Python and SQL is a must.

Additional Information

SIXT is the company with legacy of more than a century offering healthy work environment, friendly work culture and continuous learning. The leadership here believes in team empowerment and challenging opportunities are offered to solve real world problems.

About us:

Apply