Solutions Engineer - Data

Job Title: Solutions Engineer - Data

Job Location: Deerfield, IL (Hybrid - 3 days/week onsite)

# Positions: 2

Employment Type: C2H

Duration: Long Term

Key Technology: Azure, Spark, SDK, SQL/NoSQL, Python/Node/Java

Job Responsibilities:

Act as the lead engineer for each domain

Collaborate with Solution Architects to ensure understanding needed for engineering level guidance to nearshore teams

Translate architecture design to engineering level guidance

Own specifying architectural designs into sprint-ready engineering tasks for assigned domain

Ensure delivery to the solution architecture within domain

Answer design questions for sprint teams

Participate in backlog refinement sessions to align team with the architecture

Act as the internal technical expert supporting Product design and Engineering teams on demonstrations and technical discussions.

Create/Update documentation such as solution design patterns and engineering standards.

Lead technical discussions around APIs, integrations, data flow, compliance and security.

Serve as a trusted advisor on best practices, technical implementation, and scalability. Skills and Experience Required:

Required:

Experience with Python, Spark, Databricks, Azure Event Hub, ADF, Delta Lake Tables

Able to write optimized ETL pipelines, manage distributed compute jobs, and handle large-scale data transformations.

Experience with Azure Data Factory (orchestration) and Azure Event Hub (ingestion/event streaming)

Should know how to manage data movement, ingestion triggers, and pipeline tuning in a production Azure environment.

Able to code in Spark, and understand execution models, partitioning strategies, caching, broadcast joins, and how these affect performance in Azure's ecosystem.

Able to collaborate with Solution Architects and lead technical discussions

Lead developer experience working with a team of at least 12 Desired:

Scala expertise

Pharmacy domain knowledge (or retail, healthcare, or regulated data domains)

Engineering standards and documentation authorship

Understanding of API design and integration fluency