Data Platform Architect & Lead Engineer

Siddharth Bhatt

Louisville, KY *********@*******.*** 415-***-**** linkedin.com/in/siddharth-bhatt Professional Summary

Lead engineer and data architect with 8+ years of experience delivering production software, cloud platforms, and data systems across healthcare, enterprise analytics, and financial automation. Combined strong backend engineering, distributed systems, and data platform expertise with hands-on GCP, BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, dbt, Kubernetes, and Terraform experience to move data initiatives from discovery through production deployment and support. Built scalable data pipelines and microservices platforms, developed and deployed AI/ML models into production, established CI/CD and DevOps practices, and translated complex requirements into solutions that product, engineering, and business stakeholders could act on. Worked as a consultative technical lead across solution discovery, architecture, implementation, testing, deployment, and production support, balancing system performance with maintainability, governance, reliability, and business value. Known for pragmatic problem solving, production-quality engineering, clear communication with technical and non-technical audiences, and mentoring teams on repeatable data and platform delivery practices.

Work History

Senior Software Engineer / Data Platform Architect Cerner Kansas City, MO Feb 2023 - Present

• Led the design and implementation of high-performance microservices platforms on GCP, integrating AI technologies to automate workflows and improve healthcare systems' efficiency, driving a 40% performance improvement across data-intensive services.

• Modernized legacy data systems to support real-time data processing and high-volume operations, migrating critical workloads to BigQuery and Dataflow to enable scalable analytics and reduce processing latency.

• Architected self-serve data platforms using Cloud Composer and dbt to empower decentralized teams with governed, reusable data pipelines while maintaining central standards for data quality and lineage.

• Designed and enforced data governance frameworks including IAM, VPC Service Controls, and data encryption across GCP environments, ensuring compliance with healthcare data security requirements.

• Drove Infrastructure as Code adoption using Terraform to provision and manage GCP resources, enabling repeatable, version-controlled infrastructure deployments across development, staging, and production.

• Built and maintained CI/CD pipelines for data and microservices deployments, reducing release cycles by 60% and improving system reliability through automated testing and observability.

• Integrated Pub/Sub and Kafka for event-driven data streaming between microservices and analytics systems, supporting high-volume, low-latency data ingestion for real-time dashboards and ML models.

• Developed and deployed machine learning models using Vertex AI and BigQuery ML for document classification and data extraction, improving data processing efficiency and accuracy in healthcare workflows.

• Collaborated with product, engineering, and data science teams to translate complex healthcare requirements into scalable, production-grade data solutions, acting as a technical advisor on architecture decisions.

• Mentored junior developers and data engineers, enforcing engineering best practices, code review standards, and repeatable delivery patterns across the team.

• Established monitoring and observability practices for data pipelines and microservices, using telemetry-driven debugging to trace failure paths and isolate regressions before release.

• Led cross-functional technical discussions on data platform strategy, balancing system performance with maintainability, governance, cost, and long-term scalability. Senior Software Engineer / Data Engineer

Splunk San Francisco, CA June 2019 - Feb 2023

• Spearheaded the design and development of scalable cloud-native systems supporting real-time data processing and analytics at high volume, ensuring system resilience and performance under production load.

• Delivered microservices-based solutions that handled high-volume traffic using GCP services including BigQuery, Dataflow, and Pub/Sub, enabling efficient data ingestion and transformation pipelines.

• Led architecture discussions and established robust DevOps practices and CI/CD pipelines that improved release cycles by 60%, reducing deployment risk and increasing engineering velocity.

• Built and maintained data pipelines using Apache Beam and Cloud Composer for batch and streaming workloads, supporting analytics and reporting for enterprise customers.

• Implemented data governance and security controls including IAM policies and VPC Service Controls to protect sensitive customer data and meet compliance requirements.

• Provided technical leadership and mentoring to junior engineers, guiding them on system design, distributed systems, and production engineering best practices.

• Drove adoption of Terraform for infrastructure provisioning, ensuring consistent and repeatable environments across multiple GCP projects and regions.

• Designed modular architecture patterns to ensure long-term system maintainability, reducing technical debt and enabling faster feature delivery.

• Collaborated with product and platform teams to define data requirements, translate them into technical designs, and deliver solutions aligned with business objectives. Software Engineer

Palantir Technologies Palo Alto, CA August 2018 - June 2019

• Built end-to-end AI systems for document classification, data extraction, and financial process automation, integrating machine learning models into production systems to improve data processing efficiency and accuracy.

• Developed internal tools and dashboards for data visibility and operational performance monitoring, enabling teams to track key metrics and make data-driven decisions.

• Collaborated with cross-functional teams to build scalable data solutions aligned with business objectives, working across data ingestion, transformation, and serving layers.

• Implemented ETL/ELT workflows and data transformation logic to support analytics and reporting use cases across financial and operational datasets.

• Contributed to code review and engineering best practices, improving code quality and reducing production incidents.

• Worked with Python and SQL for data processing, model development, and automation of manual workflows, reducing operational overhead.

• Participated in architecture discussions and technical design reviews, contributing to the design of modular, maintainable systems.

Skills

Cloud & Data Architecture: GCP, BigQuery, BigLake, Google Cloud Storage, Dataflow, Apache Beam, Dataproc, Spark, Cloud Composer, Airflow, Pub/Sub, Kafka, Looker, Vertex AI, BigQuery ML, Dataplex, IAM, VPC Service Controls, Data Masking, Data Encryption, Data Governance, Data Warehousing, Data Modeling, ETL/ELT, Data Migration, AWS to GCP Migration, PB-scale Migration

Data Engineering & Processing: dbt, SQL, Python, Java, Apache Beam, Spark, Hadoop, Batch Processing, Stream Processing, Real-time Data Processing, Data Pipelines, Feature Engineering, Data Transformation, Data Quality, Data Lineage, Data Catalog, Metadata Management Infrastructure & DevOps: Terraform, Pulumi, Infrastructure as Code, GKE, Kubernetes, Docker, CI/CD, DevOps, Agile, Git, Version Control, Automation, Monitoring, Observability, Site Reliability Engineering

AI & Machine Learning: Vertex AI, BigQuery ML, Machine Learning, AI Systems, Document Classification, Data Extraction, Model Deployment, MLOps, Model Monitoring, AI Workflow Automation, Generative AI, LLM Integration

Software Engineering: Microservices, REST APIs, Distributed Systems, Cloud-native Systems, System Design, Architecture, Scalability, Performance Optimization, Legacy System Modernization, Technical Leadership, Mentoring, Cross-functional Collaboration, Stakeholder Management

Education

Master of Science (MS), Computer Science, California State University - East Bay (2016 - 2018) Bachelor of Engineering (B.E.), Computer Science, Gujarat Technological University (2012 - 2016)

Contact this candidate