Senior Data Engineer Cloud & ETL Architecture

PROFESSIONAL SUMMARY

Results-driven Data Engineer with strong expertise in end-to-end SQL development, multi-source data migration, and cloud-based data integration. Skilled in modernizing on-prem systems and delivering scalable pipelines across AWS, Azure, PostgreSQL, and SQL Server environments. Experienced in building robust ETL/ELT solutions using SSIS, Azure Data Factory, Apache NiFi, Python, and PySpark, with a proven track record of converting legacy systems into cloud-native architectures. Adept at data mapping, validation, reconciliation, and performance tuning across Oracle, DB2, and SQL Server platforms. Known for bridging business and technical teams to design reliable, automated data workflows that improve accuracy, scalability, and operational efficiency.

Technical Skills:

AWS, Azure, SQL Server, PostgreSQL, Oracle, DB2, Azure Data Factory (ADF), SSIS, Apache NiFi, Python, PySpark, AWS Glue, EMR, S3, RDS, SQL development, T-SQL, PL/pgSQL, data migration, ETL/ELT pipeline design, data mapping, data validation, reconciliation, data modeling, performance tuning, Git, GitLab, Jira, Scrum Master, Bitbucket, SourceTree, Linux, Windows Server, AIX.

PROFESSIONAL EXPERIENCE

Charter Communications

Sr Data Engineer April 2025 – Current

Summary: Supported end-to-end SQL development and led the migration of on-prem SQL Server workloads to AWS and PostgreSQL. Built cloud data pipelines using Apache NiFi and PySpark, rewrote T-SQL into PostgreSQL, and ensured accurate, validated data movement across on-prem and cloud environments.

Responsibility:

Led end-to-end SQL development including designing and optimizing stored procedures, functions, complex queries, and transformation logic supporting enterprise analytics and operational systems.

Played a key engineering role in the migration of on-prem SQL Server workloads to AWS, including schema redesign, data type alignment, and rewriting T-SQL into PostgreSQL-compatible SQL for cloud-native performance.

Developed and automated data ingestion and migration pipelines using Apache NiFi, orchestrating flow-based processing from SQL Server to AWS S3, S3 to PostgreSQL, and cross-environment validations.

Leveraged PySpark to build scalable batch-processing jobs on AWS EMR/Glue for large-volume table migrations, data normalization, and post-migration reconciliation.

Built and maintained ETL/ELT frameworks using Python, AWS Glue, NiFi, and PostgreSQL to support incremental loads, full refreshes, and historical backfills.

Collaborated with cloud architects and DBAs to design the AWS landing zone, data storage patterns, RDS/Postgres configurations, and pipeline orchestration strategy.

Executed comprehensive data validation and reconciliation between on-prem SQL Server and cloud PostgreSQL systems, ensuring accuracy, completeness, and referential integrity across all migration waves.

Tuned SQL workloads post-migration by optimizing queries, indexing strategies, partitioning, and resource configurations within PostgreSQL and AWS environments.

Documented migration playbooks, SQL conversion guidelines, and NiFi/PySpark pipeline designs to standardize future cloud migration efforts.

Worked in Agile Scrum teams, participating in sprint planning, daily stand-ups, and iterative delivery of migration and ETL solutions.

Global Refuge

Sr ETL Developer August 2024 – January 2025

Summary: Led multi-source data migrations from DB2, Oracle, SQL Server, and flat files into SQL Server and Azure SQL. Developed ETL pipelines using SSIS and Azure Data Factory, performed data mapping and validation, and modernized legacy integrations for improved reliability and scalability.

Responsibility:

Led major data migration initiatives, integrating and consolidating datasets from DB2, Oracle, SQL Server, flat files (CSV/XML), and cloud sources into centralized SQL Server and Azure SQL environments.

Designed and developed end-to-end ETL pipelines using SSIS and Azure Data Factory, enabling high-volume data movement, cleansing, and transformation across multiple migration phases.

Built detailed source-to-target mapping documentation covering complex relationships across legacy systems, ensuring accurate transformation logic and business-rule alignment.

Executed thorough data profiling, quality checks, and reconciliation to validate completeness, accuracy, and consistency during multi-wave migrations.

Re-engineered legacy SSIS packages into cloud-native ADF pipelines, modernizing data flows, adding orchestration layers, and improving pipeline reliability and auditability.

Created reusable components such as parameterized pipelines, automated validation scripts, error-handling frameworks, and logging modules for both SSIS and ADF.

Optimized ETL performance through parallelization, partitioning strategies, and efficient transformation logic within SSIS data flows and ADF copy activities.

Collaborated with business SMEs, system owners, and data governance teams to resolve data gaps, identify transformation requirements, and validate functional outcomes across multiple systems.

Supported UAT, cutover, and production migration cycles by delivering runbooks, technical documentation, and triaging data-related defects.

Collaborated in Agile development cycles, contributing to sprint deliverables, backlog refinement, and continuous integration of ETL pipelines.

Prosperity Bank, Sugarland, Texas

Sr. Data Engineer October 2022– May 2024

Summary: Led the design, development, and deployment of SQL Server Integration Services SSIS packages, SQL Server Reporting Services SSRS reports, and OLAP cubes at Prosperity Bank, optimizing data transformation, maintenance, and reporting processes across diverse data sources and formats.

Responsibility:

Collaborated on table design and report development with technical

teams.

Developed SSIS packages for data transformation, including

interface stored procedures.

Developed, optimized, and maintained a range of complex stored procedures for data manipulation, aggregation, and reporting, supporting business-critical processes.

Improved query performance by 30% through refactoring and optimizing complex queries and stored procedures.

Deployed SSIS packages and SSRS reports to production servers.

Extracted and transformed data from various sources using SSIS ETL tool.

Monitor and resolve issues in production, such as query inefficiencies, server health, and broken jobs in SQL Server Agent.

Successfully reduced production job failures by creating clear and actionable steps for job recovery and resolution.

Developed complex SSRS reports and managed report authoring

and delivery.

Built and optimized cubes for production applications using SSAS.

Contributed to logical and physical data modeling, database design,

and T-SQL programming.

Developed complex SQL stored procedures for ad hoc report generation using SSRS.

Utilizing tools like Remedy for project management and task tracking to ensure efficient and collaborative delivery of solutions.

Managed database queries and test cases for report validation

Tory Burch, New York, NY

Sr. ETL Developer August 2019 – September 2022

Summary: Created efficient SSIS packages, tune performance, monitor server jobs, resolve service tickets, lead SQL Server migrations, conduct design reviews, configure SSRS, train interns in ETL, and assist with C# programming and system design.

Responsibilities:

Developed and maintained robust stored procedures for critical business operations, such as data extraction, transformation, and reporting, ensuring smooth integration with application logic.

Develop SSIS packages for data extraction and transformation, including performance tuning.

Monitor server jobs, troubleshoot issues, and lead migration projects.

Refactored legacy T-SQL queries and stored procedures that had performance bottlenecks, reducing query execution time by more than 40% and improving overall system performance.

Handle service tickets, prioritize issue resolution, and assist with SSRS report configuration.

Automated routine database tasks such as data aggregation and reporting using stored procedures, leading to a reduction in manual errors and time spent on data processing.

Act as a Scrum Master to facilitate Agile ceremonies (e.g., sprint planning, daily stand-ups, retrospectives), remove impediments, and ensure the team adheres to Agile principles and practices.

Marriott International, Bethesda, MD

Sr. SQL Developer April 2017 – July 2019

Summary: Led Data Warehouse creation, SSIS package development, TSQL object implementation, DataMart creation, collaboration with Business Analysts, production job monitoring, post-production issue handling, SSRS report generation, OLAP cube implementation, and object deployment.

Responsibilities:

Led Data Warehouse creation and migration from IBM to Microsoft

SQL Server, including SSIS package development for data loading.

Collaborate closely with business teams and developers to troubleshoot issues and enhance the overall performance of T-SQL-based applications.

Conducted in-depth analysis of T-SQL queries and identified opportunities for optimization, reducing execution time significantly.

Managed SSIS packages for vendor data transfer, collaborated with

Business Analysis and monitored production jobs.

Addressed post-production issues, collaborated on SSRS report

creation, implemented OLAP cubes, and oversaw object deployment across regions.

DataLab USA, Silverspring, MD

Jr. BI Developer May 2015 – March 2017

Summary: Help develop and optimize SQL databases, create and maintain SSIS packages for ETL processes, and write and improve T-SQL queries and scripts. Support data migration and integration projects, collaborate with senior developers and stakeholders to meet business needs, perform data analysis and reporting, troubleshoot issues, and document your work thoroughly.

Responsibilities:

Assist in the development, implementation, and optimization of SQL databases.

Design, develop, and maintain SSIS packages for ETL processes.

Write and optimize SQL queries, stored procedures, and scripts.

Support data migration and integration projects.

Collaborate with senior developers and stakeholders to understand business requirements and translate them into technical solutions.

Perform data analysis and reporting tasks to support business decision-making.

Troubleshoot and resolve database and ETL-related issues.

Document processes, procedures, and code effectively.

Contact this candidate