Sr. Data Architect

Location: Elk Grove, CA

Description:

Hybrid role 3X a week in office in Elk Grove, CA; no remote capabilities.

This is a direct hire opportunity.

Summary:

We're looking for a Senior Data Architect to lead the design and optimization of our Databricks Lakehouse platform on Google Cloud Platform. In this role, you'll guide a team of data engineers, own end-to-end data architecture, and build scalable pipelines that support analytics, reporting, and machine learning across the organization. This position requires deep Databricks expertise, strong leadership, and the ability to communicate data strategy to both technical and executive teams.

Responsibilities:

Lead and mentor a high-performing data engineering team

Own Databricks architecture, including Spark, Delta Lake, and Lakehouse design

Implement Unity Catalog for governance, access control, and lineage

Optimize SQL workloads, Spark jobs, and overall platform performance

Build scalable pipelines for structured, semi-structured, and unstructured data

Integrate Databricks workflows into CI/CD using Git and DevOps best practices

Ensure strong data security, masking, encryption, and audit logging

Partner with analysts, data scientists, and business leaders to deliver high-impact data solutions

Qualifications:

10+ years in data engineering or data architecture

Deep hands-on experience with Databricks (Google Cloud Platform preferred), Spark, PySpark/Scala, and Delta Lake

Strong cloud experience (Google Cloud Platform preferred; AWS/Azure acceptable)

Experience with vector databases and embeddings for RAG/LLM retrieval

Advanced SQL and data warehousing expertise

Proven ability to optimize ETL jobs and cluster performance

Strong background in data governance and security (Unity Catalog or similar)

Leadership experience and excellent communication skills

Agile team experience

Tech Stack:

Databricks, Spark, Delta Lake, Unity Catalog, PySpark, Python, SQL, Google Cloud Platform Storage, Pub/Sub, vector databases, Git/GitLab, Jenkins, Terraform (plus), JIRA, Confluence, Looker Studio, Power BI.

Databricks Data Engineer certification; experience with Kafka, Pub/Sub, Airflow, and BI tools.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!