Data Engineer Sql Server

Lakshmi Balanagu

**********@*****.*** 412-***-****

Sr. Data Engineer

Summary

Results-driven Sr. Data Engineer with 8+ years of experience in data warehousing, ETL development, and data migration. Expertise in designing and developing scalable ETL solutions, data modeling, and performance tuning for large-scale data warehouses. Strong hands-on experience with Teradata, SQL Server, Informatica, Snowflake, and GCP. Adept at collaborating with cross-functional teams to drive data-driven decision-making. Passionate about optimizing data pipelines, reducing latency, and enhancing system performance.

Technical Skills

ETL & Data Integration: Informatica PowerCenter, SSIS, Talend, DataStage

Databases: Teradata, SQL Server, Snowflake, Oracle, MySQL, PostgreSQL

Cloud Technologies: Google Cloud Platform (GCP), BigQuery, AWS Redshift, Azure Synapse

Scripting & Programming: SQL, PL/SQL, T-SQL, Python, UNIX Shell Scripting, Scala

Data Modeling: Star Schema, Snowflake Schema, OLTP/OLAP, Erwin, Data Vault

Big Data Technologies: Hadoop, Spark SQL, Hive, S3, Kafka

Reporting & Visualization: Tableau, SSRS, Power BI, Looker, MicroStrategy

Tools & Utilities: BTEQ, Fast Load, MultiLoad, Fast Export, TPT, Putty, WinSCP, Airflow

Professional Experience

Sr. Data Engineer

Verizon, Ashburn, VA Dec 2019 - Present

Designed and developed end-to-end data pipelines to process big data on on-prem Hadoop and GCP (BigQuery, Composer).

Migrated Teradata-based data warehouse to Snowflake using Snowcat and optimized ETL processes, reducing data processing time by 40%.

Automated data workflows between Hadoop, Teradata, and GCP, ensuring 99.9% data availability.

Developed orchestrated workflows using Apache Airflow and Composer to streamline ETL processes.

Utilized Teradata utilities (BTEQ, Fast Load, MultiLoad, TPT) for efficient data processing and improved data extraction time by 30%.

Optimized SQL queries using Teradata Explain and Indexing strategies, reducing execution time by 50%.

Led the migration of workflows from development to production, ensuring a seamless transition with zero downtime.

Developed MicroStrategy reports and dashboards, working on schema objects, report optimizations, and performance tuning.

Optimized Tableau reports, implementing data blending, calculated fields, and integrating Tableau with Teradata to enhance performance and usability.

Optimized data workflows in KNIME, improving processing times by up to 40% through parallel processing, data aggregation, and efficient node usage.

Created reusable workflow components and templates within KNIME, enhancing team productivity and reducing setup time for new projects.

Engineered scalable data workflows in Alteryx to handle large datasets and improve processing efficiency, reducing runtime by 30% on key processes.

Teradata Developer / MicroStrategy Developer

Charter Communications, St. Louis, MO Oct 2018 - Dec 2019

Developed ETL solutions using Informatica to load data into Teradata from various source systems.

Optimized complex SQL queries and improved database performance, reducing execution time by 60%.

Designed primary indexes, secondary indexes, and partitioned tables for optimized data access and distribution across AMPs.

Created and maintained Teradata macros, views, and stored procedures, improving data retrieval efficiency.

Involved in migration projects from Oracle/DB2 to Teradata, ensuring data integrity and consistency.

Designed and optimized MicroStrategy reports, improving query execution and visualization performance.

Integrated Tableau with Teradata to create interactive dashboards, utilizing calculated fields and advanced data blending techniques.

Business Intelligence Developer / SQL Developer

Business Intelligence Solutions Inc. April 2018 - Sep 2018

Developed Informatica mappings to extract, transform, and load data from Hadoop to a data warehouse.

Wrote PL/SQL scripts, stored procedures, and views for data transformation, leading to a 20% improvement in query performance.

Conducted unit testing, debugging, and data validation for ETL processes, ensuring 99.99% data accuracy.

Optimized data warehouse performance using execution plans, partitioning, and ETL tuning techniques.

Application Developer

Eagle Creek, Eden Prairie, MN Feb 2017 - Mar 2018

Designed and optimized T-SQL queries and stored procedures, reducing report generation time by 45%.

Developed SSIS packages to automate ETL workflows, minimizing manual intervention.

Created SSRS reports for business intelligence and analytics, increasing reporting efficiency by 30%.

Migrated DTS packages from SQL Server 2000 to SSIS, enhancing performance and maintainability.

Software Engineer

Reliable Software Solutions Inc, MI Feb 2016 - Jan 2017

Created and optimized SQL Server stored procedures, views, and triggers, improving data processing efficiency.

Developed SSIS packages to extract, transform, and load data from diverse sources, ensuring data quality and consistency.

Performed data validation, error handling, and troubleshooting in ETL processes, reducing failures by 20%.

Scheduled SQL Server Agent jobs to automate ETL workflows, improving operational efficiency.

Education

Bachelor’s in Electronics and Communication Engineering

JNTU, India

Key Achievements

Successfully migrated a Teradata-based data warehouse to Snowflake, improving performance by 30%.

Automated data ingestion pipelines, reducing manual effort by 50%.

Optimized SQL queries, reducing query execution time by 40%.

Designed and implemented real-time data streaming solutions using Kafka and Spark, improving data processing speeds by 35%.

Contact this candidate