Databricks Solutions Architect

Job Description

540 is seeking a Databricks Solutions Architect to serve as an embedded technical leader for customer engagements as part of the Databricks Partner Program (DPP). In this role, you will provide deep architectural expertise and hands-on leadership for complex Databricks implementations, operating as a long-term extension of the Databricks Professional Services team.

You will act as the primary technical authority on Databricks for assigned customer engagements, guiding architecture, delivery, and best practices while working side by side with customer teams, Databricks PS, and partner consultants. This role is ideal for a senior data platform expert who thrives in complex environments, enjoys mentoring delivery teams, and drives large-scale data platform success.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel

Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance

Education Requirement: Bachelor's Degree in Computer Science or related engineering field (preferred)

540 Internal Thrive Level: Senior Data Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don't just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU'LL DRIVE IMPACT

Serve as the embedded technical lead for Databricks customer engagements

Own Databricks platform architecture, design decisions, and technical standards

Lead delivery of complex data pipelines and analytics workloads on Databricks

Provide deep expertise in Apache Spark internals, optimization, and scalability

Guide customers on Databricks best practices across ingestion, transformation, and analytics

Partner closely with Databricks Professional Services leadership on delivery strategy

Mentor and oversee partner and customer delivery teams

Ensure solutions meet Databricks PS governance, security, and quality standards

Drive adoption, platform maturity, and long-term customer success

REQUIRED SKILLS & EXPERIENCE

10+ years of experience in consulting or related client facing roles

7+ years of experience in data engineering or related technical roles

Databricks Data Engineering Professional certification

6+ Databricks projects delivered with hands-on architectural leadership

Deep expertise in Apache Spark, including runtime internals and optimization

Strong experience designing large-scale, distributed data platforms

Advanced SQL and Python expertise (Scala strongly preferred)

Deep working knowledge of at least one major cloud platform (AWS, Azure, or GCP)

Experience operating in regulated or enterprise-scale environments

NICE TO HAVE

Experience serving as a Solutions Architect or long-term embedded consultant

Expertise across multiple cloud platforms (AWS, Azure, GCP)

Familiarity with CI/CD, infrastructure-as-code, and production deployment patterns

Working knowledge of MLOps and advanced analytics workloads

Experience with Unity Catalog, data governance, and security architectures

Prior experience enabling or mentoring consulting teams at scale

Exposure to Databricks enablement programs, Partner Academy, or Train-the-Trainer models

BENEFITS & PERKS

Flexible PTO + all Federal holidays off

Health, dental and vision insurance plans

Flexible Spending Account (FSA)

401k with employer match

Company-sponsored life insurance, short- and long-term disability

Professional development (training, certifications, conferences)

Paid cloud developer accounts

Referral bonuses

HQ office perks (parking / metro reimbursement, nitro coffee & lunches)

Annual social events (540 Week, hackathon, charity golf tournament, etc.)

Access to 540's Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Full-time

Fully remote