Senior Data Engineer

This confidential search is being led by Brogan Search Partners for our client. We are the premier recruiters in Product, Engineering and Data for Consumer, Retail, Luxury, DTC in NYC.

About Us

We are a high-end global art company with a presence in New York, London, Los Angeles, Hong Kong, and Paris. Our organization is home to a dynamic program of innovative exhibitions across a range of media and genres. Active in both the primary and secondary art markets, we support a distinguished roster of artists and estates worldwide.

Position Overview

Who We Are:

Our Data Team operates at the intersection of technology, art, and global markets. We manage and continuously evolve the company's data platform, enabling critical functions across Sales, Client Development, Finance, and Operations.

Our core focus areas include:

Data Engineering: Build scalable infrastructure, develop data taxonomies, and create analyst-friendly datasets.

Data Analysis: Deliver clear insights and actionable recommendations to drive decision-making.

Data Products: Develop cutting-edge tools and applications using Generative AI and Machine Learning to unlock new capabilities across the organization.

The Role:

As a Senior Data Engineer, you will architect and implement robust data pipelines, orchestration systems, and ETL processes that support both analytics and AI-driven products. You’ll be responsible for engineering scalable data structures and integrations that enable advanced data use cases, including Generative AI.

Who You Are:

You excel at turning complex or ambiguous business problems into clear engineering solutions. You bring deep expertise in data architecture and modern engineering practices, and you're eager to push boundaries by integrating with Generative AI systems and scalable workflows.

Responsibilities:

Design, build, and maintain scalable and reliable data pipelines, ETL frameworks, and orchestration systems.

Develop structured datasets, taxonomies, and ontologies to support a range of business and AI applications.

Lead the integration of Generative AI into our data platform, including APIs and retrieval-augmented generation (RAG) methodologies.

Partner with analysts, product teams, and stakeholders to ensure data solutions are actionable and aligned with business needs.

Provide technical leadership on scalability, architecture, and integration of new data-driven tools and products.

Requirements:

Proven experience with data engineering, pipeline architecture, ETL systems, and orchestration tools (e.g., DBT, Airflow).

Expertise in Python, SQL, and modern data infrastructure (e.g., Databricks, Snowflake, AWS, GCP).

Strong background in data modeling, ontology design, and semantic data concepts.

Hands-on experience integrating Generative AI tools and APIs into data systems.

Experience with RAG and related AI techniques strongly preferred.

Excellent communication skills for both technical and non-technical audiences.

What We Offer:

An intellectually and culturally rich environment where your technical work drives innovation.

High autonomy and the chance to shape next-generation data capabilities within the art industry.

A unique opportunity to pioneer data products at the intersection of art, technology, and global commerce.

Location: NYC (Headquarters)