Senior Data Engineer (ADB Spark)

We are looking for a motivated Senior Data Engineer (ADB + Spark) who is willing to dive into the new project with a modern stack. If you’re driven by a curiosity to learn and a desire to produce meaningful results, please apply!

Work at Exadel - Who We Are

We don’t just follow trends—we help define them. For 25+ years, Exadel has transformed global enterprises. Now, we’re leading the charge in AI-driven solutions that scale with impact. And it’s our people who make it happen—driven, collaborative, and always learning.

About Our Customer

You will work with the 6th-largest privately owned organization in the United States. The сustomer is one of the "Big Four" accounting organizations and the largest professional services network in the world in terms of revenue and number of professionals. The company provides audit, tax, consulting, enterprise risk, and financial advisory services to 263,900 professionals globally.

Project Tech Stack

Azure Cloud, Microservices Architecture, .NET 8, ASP.NET Core services, Python, Mongo, Azure SQL, Angular 18, Kendo, GitHub Enterprise with Copilot

Requirements

5+ years of hands-on experience in software development

Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric

Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar

Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables

Proven expertise in data processing, analysis, and transformation workflows

Strong analytical and problem-solving abilities with a detail-oriented mindset

Practical and pragmatic approach to balancing standardized processes with flexibility to meet project goals effectively

Excellent organizational skills with the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines

Nice to have

Experience working with Azure Cloud services (or other major cloud platforms), including a range of SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis, and more

Familiarity with FastAPI

Expertise in containerization and orchestration tools such as Docker and Kubernetes

Solid understanding of microservices architecture and its implementation in scalable systems

English level

Intermediate+

Responsibilities

Define and enforce best practices and coding standards across the project

Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality

Working both independently and in close collaboration with others in the team

Communicating clear instructions to team members and helping manage the flow of day-to-day operations

Communicating with the client regularly

Design, develop, and maintain robust and scalable Spark applications

Write clean, maintainable, and efficient code following best practices and coding standards

Optimize code for performance and scalability, ensuring efficient data handling

Work closely with cross-functional teams to deliver high-quality software solutions

Identify and resolve technical issues, ensuring the reliability and performance of applications

Create and maintain comprehensive documentation for code, processes, and workflows

Provide guidance and mentorship to junior developers, fostering a collaborative and productive team environment