Data Engineer Senior Software

Craig Flockhart

Senior Software/Data Engineer

Los Angeles, CA

***************@*****.*** 424-***-****

Professional Summary

Highly skilled software and data engineering leader with extensive experience architecting and implementing scalable, high-performance data and backend platforms. Proven expertise in designing, building, and optimizing big data pipelines using cutting-edge technologies like Spark, Scala, and cloud platforms (AWS, Azure).

Experience

Databricks Inc. — Resident Solutions Architect

Feb 2022 - Feb 2025

●Designed and built large-scale ETL/ELT pipelines on Databricks for clients such as John Deere, Doordash, Kroger, and Apple, utilizing Scala, Python, Java and SQL on AWS and Azure.

●Developed batch and streaming data pipelines, ensuring high availability and performance optimization.

●Provided architectural guidance to customer data engineers, ML engineers and data scientists on Spark and Databricks best practices, including Delta Lake performance tuning and infrastructure scaling.

●Led the migration of several customers from Snowflake to Databricks, in SQL, dbt and Scala.

●Diagnosed and resolved complex Spark performance bottlenecks, working with petabyte-scale data.

●Integrated Airflow, Dagster, Kafka, Terraform, and Pulumi for pipeline orchestration and infrastructure management.

HyreCar Inc., Los Angeles — Lead Data Engineer

March 2018 - Jan 2022

●Led Scala-based data engineering initiatives, designing robust data ingestion frameworks and integration pipelines.

●Implemented real-time streaming applications using Kafka and Databricks, enhancing operational data flow.

●Applied asynchronous programming techniques (Futures, ZIO) to optimize data processing efficiency.

●Integrated the data platform with an event driven system using Typescript.

●Led a project to import AWS Redshift data to Databricks.

The Bouqs Inc., Los Angeles — Senior Software Engineer

March 2015 - March 2018

●Co-led the development of a Scala/Akka-based distributed data application, managing supply chain logistics.

●Designed and deployed AWS-hosted microservices for real-time data analytics and order fulfillment.

Nasty Gal Inc., Los Angeles — Senior Software Engineer

Nov 2012 - Feb 2015

●Built a Scala-based inventory and order management system, ensuring data consistency across distributed systems.

●Spearheaded migration to cloud-based data solutions, reducing operational costs and improving scalability.

Steelhouse Inc (now MNTN) — Senior Java Engineer

Nov 2011 - Nov 2012

●Bult multi-threaded systems for big data processing of ad data with Java, using Cassandra as the data store.

Technical Skills

●Big Data & Cloud: Spark, Databricks, Flink, AWS, Azure, Delta Lake, Snowflake, Redshift

●Programming: Scala, Java, Python, SQL, C++

●Data Processing & Orchestration: Airflow, Dagster, dbt

●Infrastructure & Automation: Terraform, Pulumi, Kubernetes, Docker

●Databases: PostgreSQL, SQL Server, MariaDB, Databricks, Redshift

●Distributed Systems: Akka, Spark, Kafka, Cassandra, Flink

●Data Governance & Observability: Unity catalog, Delta Live Tables.

●

Certifications & Awards

●Databricks Certified Professional Data Engineer

●AWS Associate Solutions Architect

●Functional Programming in Scala (Coursera)

●Introduction to Machine Learning (Coursera)

Education

The University of Birmingham, UK

B.Sc (Hons) Physics Aug 1988 - June 1991

The University of Nottingham, UK

Ph.D. Electrical Engineering June 1992 - June 1996

Languages

Scala, Java, Python, SQL, C++

Contact this candidate