Databricks Tech Lead (W2 / USC / GC)

Job Title: Databricks Tech Lead

Location: Multiple Client Locations in US (Hybrid 2 days Onsite/Week)

Duration: 6+ Months

Rate: $Market/Hour W2 only

Eligibility: W2 only – Open to US Citizens, Green Card Holders (C2C not allowed)

Description:

As a Tech Lead, you will work closely with business stakeholders, solution architects, product owner, scrum master, and subject matter experts (SMEs) to understand requirements and deliver high-quality, scalable solutions on Azure Databricks.

Position Requirements:

• 7+ years in data/platform/analytics engineering, including 2+ years leading technical teams or workstreams.

• Proven production delivery on Databricks (with strong Azure Databricks experience preferred).

• Strong Apache Spark expertise (PySpark/Scala): distributed processing, troubleshooting, and performance tuning.

• Deep Delta Lake knowledge: ACID tables, compaction, Z-Ordering, schema evolution, and batch/streaming patterns.

• Experience building scalable batch and streaming pipelines, including orchestration/operationalization (scheduling, dependencies, retries, idempotency).

• Strong Azure data platform background, including Azure Data Lake Storage (ADLS) architecture and best practices; familiarity with Azure Data Factory (ADF), Azure Synapse Analytics, and related services.

• Advanced programming skills in Python and SQL, plus hands-on Java experience (e.g., integrations/services or Spark/platform utilities).

• Cloud fundamentals in at least one major platform (Azure/AWS/Google Cloud Platform (GCP)): identity and access management (IAM), storage, networking basics, and cost controls.

• Working experience in Java (e.g., building integrations/services, Spark/streaming components, or platform utilities).