Post Job Free
Sign in

Senior Data Engineer

Company:
VxLabs
Location:
Giza, Egypt
Posted:
May 09, 2024
Apply

Description:

Innovate and Lead with Advanced Data Technologies at VxLabs

Are you a visionary data engineer looking to push the boundaries of technology and data analytics? VxLabs seeks an experienced Senior Data Engineer to join our dynamic team. This role is pivotal in architecting and optimizing our data products, leveraging the power of cloud technologies and cutting-edge tools like Spark, Python, Airflow, Kafka and Elasticsearch. Your expertise will help us lead advancements in automotive tech. Join our team to push the boundaries of what's possible on the road and beyond.

What You'll Be Doing:

· Design and build scalable and efficient data architectures to support the creation of data-driven products.

· Design, construct, and maintain robust data pipelines that efficiently process large volumes of data.

· Use advanced programming skills to automate data collection, transformation aggregation, and processing tasks.

· Design and manage database solutions, both SQL and NoSQL, to store and retrieve data effectively. Ensure data solutions are optimized for speed and performance.

· Manage Big Data environments to enhance data management and analytics capabilities.

· Mentoring junior Data Engineers and sharing your expertise to elevate the team's skills.

· Work closely with product managers, developers, and other stakeholders to define requirements, set technical direction, and integrate data capabilities into broader product offerings.

Requirements

· Minimum of 5 years' experience in a Data Engineering role or similar.

· Proficiency in cloud services, especially AWS, including but not limited to EC2, RDS, S3, and Lambda.

· Specialized knowledge in big data frameworks like Apache Spark and workflow management platforms like Apache Airflow.

· Strong proficiency in Python, with a working knowledge of other scripting languages.

· Expertise in search technologies such as Elasticsearch, Solr, or comparable platforms.

· Extensive understanding of both SQL and NoSQL databases, including aspects of performance optimization.

· Skilled in data modeling practices and tools, capable of managing extensive data infrastructures.

· Comprehensive knowledge of data serialization formats (e.g., Avro, Parquet, Protocol Buffers, JSON) and streaming technologies (e.g., Apache Kafka, Apache Flink).

· Experience in Agile/Scrum methodologies, along with proficiency in version control tools.

· Familiarity with Docker and Kubernetes.

· Familiarity with practices of continuous integration (CI) and continuous deployment (CD).

· Excellent problem-solving capabilities and a track record of effective collaboration in team settings.

· A Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline is required.

Nice to Have:

· Prior experience in the automotive industry or working with IoT platforms.

· Experience with machine learning frameworks.

· Prior work in real-time data processing and analytics.

Benefits

Compensation packages in EUROs and best career path development.

A dynamic and fast-growing company that works on top-notch technology.

Flat, friendly, and open doors environment.

Allowance to work from home.

Private medical insurance package.

Transportation allowance package.

Social insurance.

Attractive annual bonus.

Apply