Data Engineer Senior

Shahid Shah

Senior Data Engineer Big Data & Cloud Solutions Architect

Address: Denver, Colorado, (80014) USA

Phone: 573-***-****

Mail: **********.****@*****.***

Professional Summary

Accomplished Senior Data Engineer with 10+ years of experience designing, building, and optimizing large-scale, cloud-based data platforms. Expertise spans AWS, Azure, GCP, and hybrid environments, with a strong focus on data pipelines, ETL, and analytics solutions. Proven ability to collaborate with business and marketing teams to deliver actionable insights, ensuring data accuracy, scalability, and performance. Skilled in big data processing, data warehousing, streaming, and data governance. Adept at leading cross-functional teams, implementing modern cloud solutions, and optimizing end-to-end data workflows for enterprise-level applications. Experienced in remote, collaborative environments with a results-driven approach. Skills

Programming & Scripting: Python, SQL, Java, Scala, R, Shell, Bash, Perl, MATLAB

Data Engineering & Architecture: ETL, ELT, Data Pipelines, Data Warehousing, Data Modeling, Data Lake Architecture, Data Mesh, Metadata Management, Data Governance, Data Quality, Master Data Management (MDM), Event-Driven Architecture

Big Data & Streaming Tools: Hadoop, Spark, Kafka, Flink, Hive, Airflow, NiFi, Presto, Impala

Cloud Platforms & Services: AWS (S3, Redshift, Glue, Lambda, EMR), Azure (Data Factory, Synapse, Databricks), GCP (BigQuery, Dataflow, Pub/Sub), Snowflake, Databricks, Teradata, Oracle Cloud

Databases & Storage: MySQL, PostgreSQL, Redshift, BigQuery, MongoDB, Cassandra, DynamoDB, Oracle, SQL Server, Redis, Elasticsearch

Analytics & Business Intelligence: Tableau, Power BI, Looker, QlikView, SAP Analytics, Google Data Studio, Advanced Excel, Statistical Analysis, Predictive Analytics

DevOps & Tools: CI/CD, Git, Docker, Kubernetes, Terraform, Jenkins, Airflow, MLflow, Version Control, Automation

Other Skills: Data Security, Compliance (GDPR, HIPAA), Cloud Cost Optimization, Performance Tuning, Solution Architecture, Scalability Design, Team Leadership, Agile & Scrum Professional Experience

Lead Data Engineer Astronomer

(04/2022 – Present)

Designed and implemented scalable ETL pipelines for processing large volumes of structured and unstructured data.

Led the architecture and deployment of cloud-based data platforms using AWS, GCP, and Azure.

Developed and maintained Apache Airflow workflows to orchestrate complex data pipelines efficiently.

Collaborated with analytics and product teams to provide reliable, high-quality data for business insights.

Implemented data modeling, warehousing, and governance standards to improve data consistency and accessibility.

Optimized data processing performance through Spark, Hadoop, and distributed computing frameworks.

Mentored junior engineers and conducted code reviews to ensure best practices and maintainable code.

Contributed to solution architecture decisions, integrating modern data tools for analytics, streaming, and batch processing.

Senior Data Engineer & BI Analyst Pure Spectrum

(07/2019 – 3/2022)

Designed and maintained robust ETL pipelines to ingest, process, and transform large datasets from multiple sources.

Developed and optimized data models and warehousing solutions to support analytics and reporting needs.

Created interactive BI dashboards using Tableau and Power BI for business stakeholders and marketing teams.

Implemented data quality checks and governance standards to ensure accuracy and reliability of insights.

Collaborated with cross-functional teams to understand business requirements and translate them into technical solutions.

Automated repetitive data processes to improve efficiency and reduce manual errors.

Supported decision-making by delivering timely, actionable insights and reports to senior management.

Data Engineer phData

(02/2015 – 06/2019)

Developed and maintained scalable ETL pipelines for processing structured and unstructured data.

Built and optimized data warehouses and data marts to support business intelligence initiatives.

Worked with Hadoop, Spark, and Kafka to implement high-performance big data solutions.

Collaborated with analysts and product teams to understand requirements and deliver actionable insights.

Implemented data quality frameworks and governance standards to ensure reliable and accurate data.

Automated data workflows and reporting processes to improve operational efficiency.

Supported the migration of on-premise data systems to cloud platforms such as AWS and Azure.

Education

Bachelor of Computer Science (2010-2014)

National University of Sciences & Technology

Contact this candidate