Senior Data Engineering Technical Lead

Rucha Bengali

SENIOR DATA ENGINEER TECHNICAL LEAD ETL, ELT, SQL, CLOUD DATA PLATFORMS

Professional Summary

Senior Data Engineer and Technical Lead with 19+ years of experience delivering scalable data pipelines, ETL/ELT workflows, data warehousing, and cloud data solutions in high-volume production environments. Hands-on expertise in Python, SQL, Apache Spark, Databricks, DBT, data modeling, validation, reconciliation, performance tuning, and backfills. Proven ability to lead full-lifecycle delivery, strengthen data quality, and support reliable analytics and reporting systems. Core Competencies

• Core Competencies: Data Engineering, ETL / ELT Development, Data Pipelines, SQL Development, Python, Apache Spark, Databricks, DBT, Data Modeling, Data Warehousing, Source-to-Target Mapping, Data Ingestion, JSON File Processing, Data Validation, Data Quality, Reconciliation, Query Performance Tuning, Backfills and Historical Loads, Production Support, CI/CD Pipelines, Git and Jenkins, UNIX Shell Scripting, AWS Cloud Data Platforms, Release Planning, Technical Leadership, Cross-Functional Collaboration

• Languages and Scripting: SQL, Python, UNIX shell scripting, Perl, SAS

• Data Platforms and Tools: Databricks, Snowflake, Google BigQuery, DBT, Ab Initio, Teradata, Oracle, SQL Server, Alation, DataGaps,Metadata Hub

• Processing and Engineering: Apache Spark, ETL, ELT, DBT transformations, data pipelines, source-to-target mapping, data quality, performance tuning, reconciliation, backfills

• DevOps and Operations: Git, Jenkins, CI/CD pipelines, Control-M, Tivoli, Kibana, ServiceNow, Jira, Kanban

• Cloud: AWS, Google Cloud Platform (GCP), BigQuery, Azure Databricks Achievements

• Led enterprise data engineering solutions across seven business domains, supporting large-scale cloud data delivery, data models, ETL workflows, lineage, reconciliation, and historical backfills.

• Built a cloud data pipeline using Azure Databricks, Apache Spark, and Python to ingest and process JSON files using Medallion-style data architecture principles.

• Improved performance of a critical daily transaction-history pipeline by redesigning partitioning and aggregation logic, reducing processing time from roughly three hours to a few minutes.

• Resolved a major production data issue caused by upstream latency, recovered a full month of missing data from alternate raw sources, rebuilt downstream balances, and restored data integrity for financial and regulatory reporting.

• Consolidated fragmented legacy data into standardized domain-based enterprise data structures with clear lineage across a production estate of 100+ jobs and 10 reporting summary tables. Professional Experience

Discover Financial Services (now Capital One)

Data Engineer / Lead Developer / Principal Associate — Data Solutions May 2023–Present

• Lead scalable enterprise cloud data engineering solutions across seven Deposits domains, covering data modeling, ETL design, source-to-target mapping, lineage, reconciliation, historical backfills, and production support.

• Develop and maintain SQL-based data pipelines for file loads, schema changes, reconciliation, backfills, and query performance tuning in support of downstream analytics and reporting.

• Built a cloud data pipeline using Azure Databricks, Apache Spark, and Python to ingest and process JSON files under a Medallion architecture.

• Implement data validation, transformation, and data quality controls across production pipelines to deliver trusted, accurate, and reliable data.

• Support metadata governance and operational monitoring using tools such as Alation, Salsa, Kibana, Control-M, and Tivoli.

• Lead architecture and design discussions, code reviews, release planning, and production-readiness activities across the data engineering lifecycle while mentoring a global engineering team of 20. Atos Syntel

Senior Consultant — FedEx / Allstate Nov 2021–May 2023

• Delivered end-to-end enterprise ETL solutions across the full development lifecycle, from requirements and design through development, UAT, deployment, and production support, using Ab Initio, SQL Server, UNIX, and SAS/CRON scheduling.

• Partnered with business, upstream, and downstream teams to resolve data-source issues and deliver stable analytics and reporting solutions.

• Supported production data operations, issue resolution, and release execution in complex enterprise environments. Bitwise Inc.

Lead Consultant / Business Analyst Jun 2013–Nov 2021 Riverwoods, IL Buffalo Grove, IL 60089 847-***-**** ************@*****.*** H1B valid till April 2029 I-140 approved

• Led data initiatives across payment-network domains, managing an offshore engineering team and delivering projects through requirements, technical design, validation, implementation, and production support.

• Worked as a Business Analyst and translated business and regulatory requirements for AML and Fraud into transaction-monitoring logic, data structures, source-to-target mappings, and release plans.

• Worked as a team lead and partnered with developers, data modelers, and business teams on Oracle-to-Teradata ingestion, data validation, UAT, and production implementations.

Discover Financial Services via Bitwise

Senior Software Programmer / Software Associate / Software Programmer 2006–2013

• Built foundational experience in ETL development, SQL programming, finance data warehousing, automated data-quality controls, Cognos reporting, scripting, and production support.

Pro-ex Solutions

Software Developer 2006–2013

• Built foundational experience in ETL development, SQL programming, finance data warehousing, automated data-quality controls, Cognos reporting, scripting, and production support.

Education

Cummins College of Engineering — Pune, India Bachelor of Engineering, Computer Science Certifications

• Python for Data Science Certificate — Cornell University (2025)

• AWS AI Practitioner Training (2026)

• Snowflake SnowPro Certification (2026)

Contact this candidate