Big Data Architect

Shilpa Sharma

Edgewater, NJ, *****-****, United States +1-551-***-**** *****************@*****.*** linkedin.com/in/shilpa-sharma-09a79519

Professional Summary

Seasoned Data Architect with over 14 years of experience designing scalable, resilient data platforms and engineering solutions in cloud-native ecosystems. Proven leadership in building big data pipelines, implementing cloud data warehouses, and optimizing performance for high-volume workloads. Skilled in AWS, Databricks, Spark, Redshift, and modern data lake architectures. Adept at leading cross-functional teams and collaborating with business stakeholders to deliver analytics-driven outcomes.

Core Competencies

Big Data Architecture & Pipeline Design

AWS Cloud Services (S3, Glue, Lambda, Redshift, Aurora)

Databricks, Delta Lake, Spark (Structured & Streaming)

Data Modeling, Warehousing & Governance

SQL/PLSQL Optimization & Performance Tuning

Agile Delivery & Project Leadership

Client Engagement & Team Mentoring

Technical Skills

Languages & Tools: Scala, Python, Spark SQL, PySpark, SQL, PL/SQL

Big Data & Cloud: Apache Spark, Delta Lake, Kafka, Kinesis, Databricks, AWS

Databases: Amazon Redshift, Aurora, Presto DB, Oracle, MySQL

DevOps/Tools: Git, Bitbucket, IntelliJ, JMeter, Postman

OS: UNIX, Linux, Windows

Methodologies: Agile, CI/CD

Professional Experience

Brillio – Big Data Architect

Aug 2022 – Apr 2025 Client: Universal Music Group

Lead data architecture for the UMB Royalty Portal, delivering scalable streaming and batch pipelines.

Designed data models and architected data ingestion workflows on AWS (S3, Glue, Lambda, Aurora).

Engineered performance-optimized Redshift schemas and complex SQL procedures for royalties.

Spearheaded the data strategy and mentored engineering teams under Brillio’s DIA practice.

Brillio – Big Data Architect

Oct 2020 – Jul 2022 Client: Align Technologies

Architected a Clinical Data Lake to process unstructured treatment data using Spark Structured Streaming.

Designed bronze-to-gold Delta Lake architecture with real-time and batch ingestion.

Reduced SLA for processing by ~50% through job optimization and design enhancements.

Led end-to-end delivery, from approach docs and design to deployment, reviews, and feedback loops.

Pareteum Corporation – Senior Big Data Engineer

Oct 2016 – Sep 2019

Developed the Manhattan and Spartan systems for large-scale Wi-Fi data analysis and ranking.

Processed and geo-located data from 1.5B+ Wi-Fi networks using Spark and Databricks.

Designed Spark jobs for Eleos ETL layer, integrating batch and streaming pipelines.

Reduced processing times by 33–50% through Spark job optimizations.

iPass India Pvt. Ltd. – Technical Lead – QA

Sep 2013 – Sep 2017

Led QA efforts for big data and backend services, ensuring reliability in authentication and billing.

Oversaw testing for high-availability microservices and data collectors in AWS.

Delivered performance, stress, and backend testing with tools like JMeter and Postman.

Education

Bachelor of Engineering (B.E.) in Electronics & Communication

Jodhpur Engineering College & Research Centre – Jodhpur, Rajasthan – 2009

Contact this candidate