Data Engineer SQL ETL Pipelines Azure Data Factory Data Wareho

SANDIP K JAISHWAL

Data Engineer SQL ETL Pipelines Data Warehousing

Email: ***************@*****.*** Phone: 404-***-****

PROFESSIONAL SUMMARY

Data Engineer with 5+ years of experience developing and maintaining data pipelines and supporting data warehouse solutions in healthcare and financial services environments. Strong expertise in SQL development, ETL/ELT processes, and data analysis to support reporting and business insights.

Experienced in building and optimizing SQL queries, stored procedures, and ETL pipelines using tools such as SQL Server, Azure Data Factory, and SSIS. Working knowledge of cloud platforms including Azure, AWS, and Snowflake, with experience handling structured and semi-structured data for analytics. Familiar with dimensional data modeling techniques including star and snowflake schemas.

Collaborative team player with experience working in Agile environments to gather requirements and deliver reliable, efficient data solutions.

CORE COMPETENCIES

•Databases and Data Platforms: SQL Server, Azure SQL Database, Snowflake, PostgreSQL, Oracle

•Programming and Query Languages: SQL, T-SQL, Python

•Database Development: Stored Procedures, UDFs, Views, Triggers, CTEs, Temporary Tables

•Performance Optimization: Query Tuning, Index Optimization, Execution Plan Analysis, SQL Profiler

•Data Engineering and ETL: SSIS, Azure Data Factory, AWS Glue, ETL and ELT pipelines, Incremental Data Loads, Batch Processing, BCP, Bulk Insert

•Big Data and Streaming: Apache Spark, Kafka

•Data Modeling and Architecture: Dimensional Modeling, Star Schema, Snowflake Schema, OLTP, OLAP

•Cloud and Data Integration: Azure Data Lake Storage Gen2, Azure Synapse, AWS S3, REST API Integration, JSON Data Processing

•Business Intelligence and Analytics: Power BI, SSRS, KPI Dashboards, Data Visualization

•ETL Transformations: Lookup, Conditional Split, Derived Column, Aggregations, Error Handling

•DevOps and Deployment: GitHub, Azure DevOps, TFS, Perforce, CI CD Pipelines

•Methodologies: Agile, Scrum, SDLC

PROFESSIONAL EXPERIENCE

UnitedHealth Group, Minnetonka, MN

Data Engineer January 2024 to Present

•Developed T SQL stored procedures views and complex queries to support reporting and analytics while improving performance through indexing and query tuning techniques

•Built and maintained ETL pipelines using Azure Data Factory and supported AWS Glue jobs to process structured and semi structured data for reporting needs

•Worked with dimensional models using star and snowflake schemas to support KPI reporting and collaborated with business teams to understand data requirements

•Assisted in developing ETL and ELT pipelines handling large datasets and supported incremental data loads to improve data refresh cycles

•Supported data ingestion processes including Kafka pipelines and assisted in near real time data flow for operational reporting

•Worked with Snowflake for data transformation and reporting support and contributed to improving query performance in SQL Server environments

•Integrated API based and JSON data sources into data pipelines ensuring consistency and usability for downstream analytics

•Prepared clean and reliable datasets for reporting and analytics and built Power BI dashboards to support business insights

•Collaborated with stakeholders including clinical finance and reporting teams to gather requirements and translate them into data solutions

•Performed data validation reconciliation and quality checks to ensure accuracy and consistency across multiple data sources

•Supported data quality and governance practices and followed data security standards including role based access and encryption

•Assisted in deployment activities and CI CD processes to support smooth release and maintenance of data pipelines

•Contributed to migration of data workloads from on premise systems to cloud environments supporting scalability and performance

•Provided production support including monitoring troubleshooting ETL failures and resolving data issues in a timely manner

•Participated in team discussions and Agile activities to deliver reliable data solutions aligned with business needs

•Developed Power BI dashboards to support business reporting and provide insights for operational and management teams

•Built reporting datasets and data models to support KPI tracking and business performance analysis

•Collaborated with stakeholders to gather reporting requirements and translate them into meaningful visualizations

•Supported creation of SSRS reports for scheduled and ad hoc reporting needs across different business functions

•Improved reporting accuracy by validating data and ensuring consistency between source systems and reports

Berkshire Hathaway,Omaha, NE

Data Engineer ETL Developer August 2021 to November 2024

•Developed T SQL stored procedures functions and views to support data processing and reporting while ensuring data accuracy and efficient query performance

•Performed query tuning using execution plans indexing strategies and SQL profiling tools to improve performance of reporting workloads

•Improved execution time of queries and batch jobs through optimization techniques supporting high volume transactional and reporting systems

•Tuned long running procedures and batch processes to improve efficiency and support daily data processing needs

•Worked with Data Vault structures including Hub Satellite and Link tables to support scalable and organized data models

•Managed large volume data movement using BCP Bulk Insert and SSIS ensuring reliable and secure data transfers

•Integrated processed data into warehouse models to support reporting and analytics use cases across business teams

•Supported financial and regulatory projects by performing data validation ETL testing and resolving data related issues

•Participated in migration of data warehouse systems from on premise SQL Server to Azure cloud improving scalability and performance

•Developed Azure Data Factory pipelines to move and transform data into Azure Data Lake and Azure SQL Database

•Built and maintained SSIS and DTS workflows including development scheduling monitoring and issue resolution

•Developed ETL processes integrating data from SQL Server flat files XML and other sources into staging and warehouse layers

•Implemented SSIS transformations such as Lookup Conditional Split Derived Column and Aggregations for data processing needs

•Maintained error handling logging and monitoring processes within ETL pipelines to ensure reliable data flow

•Supported Spark based data processing workloads for handling large datasets in batch processing environments

•Built ETL workflows to deliver validated and reconciled data to reporting layers for business use

•Performed data validation cleansing and reconciliation to ensure data consistency across systems

•Collaborated with business and technical teams to gather requirements and deliver data solutions aligned with business needs

•Participated in Agile activities including sprint planning and task execution to support project delivery

•Maintained documentation for database objects ETL workflows and processes to support ongoing operations

•Managed database objects including tables views and stored procedures while supporting day to day database operations and data availability

•Monitored database health and supported backup and recovery processes to ensure data reliability and system stability

•Assisted in maintaining database security by managing user roles and access permissions based on business requirements

•Supported database deployments and schema changes across environments ensuring smooth releases and minimal downtime

•Worked with development and operations teams to troubleshoot database issues and maintain system performance

The Cigna Group, Bloomfield, CT

ETL and SQL Developer March 2020 to July 2021

•Collaborated with business analysts and technical teams to gather requirements and develop ETL solutions based on business needs

•Supported full lifecycle data warehouse development including data modeling ETL development deployment and production support

•Developed and optimized T SQL tables views stored procedures and indexes to improve data processing and reporting performance

•Performed SQL query tuning and indexing to reduce report latency and improve performance in high volume environments

•Worked with dimensional models including fact and dimension tables using star and snowflake schemas for reporting

•Developed SSIS ETL packages using transformations such as Lookup Derived Column Conditional Split and Aggregations

•Built and maintained data ingestion pipelines using Azure Data Factory and SSIS for integrating multiple data sources

•Implemented incremental load processes and CDC techniques to support efficient data updates across systems

•Supported migration of ETL workflows from on premise systems to cloud platforms including Azure and AWS

•Worked with Snowflake for data loading and transformation supporting reporting and analytics requirements

•Supported batch data processing workflows using Spark for handling large datasets

•Assisted in building analytical solutions using SSAS Power BI and SSRS for reporting and dashboards

•Developed reports using Power BI and SSRS to support business insights and operational reporting

•Integrated API based and JSON data sources into ETL workflows for data processing

•Performed data validation reconciliation and quality checks to ensure accuracy and consistency

•Followed security and compliance practices including access controls and data protection standards

•Provided production support for ETL jobs SQL processes and reporting systems resolving issues as needed

•Participated in Agile processes including sprint planning and task execution to deliver data solutions

•Worked with healthcare datasets including clinical and claims data to support analytics use cases

•Implemented indexing strategies on large tables to improve query performance and reduce data retrieval time

•Reviewed existing indexes and removed redundant or unused indexes to optimize database performance

•Used execution plans to identify missing indexes and applied changes to improve query efficiency

•Supported performance tuning by analyzing index usage and making adjustments based on workload patterns

•Worked with development teams to apply indexing best practices in database design and query development

EDUCATION

Master of Business Administration

Contact this candidate