Sql Server Data Engineer

Current City: Chicago, IL

Mobile: 1-708-***-****

E-mail: **************@*****.***

LinkedIn: https://www.linkedin.com/in/mikel-myrteza-708a57a9/

PROFESSIONAL SUMMARY

Experienced Senior Data Engineer adept at designing, optimizing, and implementing data pipelines. Proficient in cutting-edge ETL technologies, cloud platforms (Azure, GCP), and collaborative problem-solving. Strong background in database management, data warehousing, and stream processing. Committed to ongoing skill enhancement and staying abreast of industry trends.

●Proficient in writing complex SQL queries to retrieve, manipulate, and analyze data from relational databases.

●Skilled in performance tuning of SQL queries and database indexing techniques to enhance query execution speed.

●Proficient in Microsoft (MSBI) Business Intelligence, specializing in ETL Data Warehouse, OLTP & OLAP utilizing SQL Server Integration Services (SSIS), Reporting & Analysis Services (SSRS & SSAS), and MS SQL Server versions spanning from 2008 to 2019.

●Demonstrated expertise in designing physical data models and crafting DDL (Data Definition Language) and DML (Data Manipulation Language) scripts for SQL Database modification and manipulation.

●Skilled in data analysis, SQL Server database development and maintenance, and data modeling to support ongoing business operations, including database auditing for user transactions and activities.

●Proficient in managing databases across on-premise and cloud deployments, with experience in migrating on-premise SQL Server schemas to Azure SQL Server DB and Azure VM.

●Experienced in migrating data from on-premises to the cloud using Azure Data Factory and Azure Data Lake Store, with a focus on Relational Data Ingestion and File System Data Ingestion.

●Knowledgeable in Azure Data Factory (ADF) and Integration Run Time (IR), with expertise in utilizing Databricks notebooks integrated within pipelines.

●Well-versed in Software Development Life Cycle (SDLC) methodologies, including RUP, Agile, and Waterfall.

●Skilled in utilizing advanced Excel features such as Power BI, Power Pivot, Power View, and Excel Data Connection for data analysis and visualization.

●Skilled in using SSIS tools such as the SSIS Designer, Package Configuration Wizard, and Deployment Wizard to streamline package development and deployment processes.

●Demonstrated expertise in implementing error handling and logging mechanisms within SSIS packages to ensure data integrity and facilitate troubleshooting.

●Familiarity with SSIS features like checkpoints, transactions, and event handlers to manage package execution and recovery in case of failures.

●Proficient in scheduling and automating SSIS package execution using SQL Server Agent jobs and Integration Services Catalog

●Experienced in addressing ethical concerns in machine learning systems, including bias, fairness, transparency, and accountability.

●Proficient in conducting feature engineering and model selection processes for building robust machine learning pipelines, employing techniques like grid search and random search for hyperparameter optimization.

●Experienced in generating and updating data visualizations in Power BI reports and Dashboards, importing data from various sources for analysis.

●Skilled in creating Power BI reports with visualization features like single and multi-row cards, waterfalls, and various chart types to provide insights for strategic business decisions.

EDUCATION

Master in Computer Science Lewis University 2022 – 2024 GPA 3.55

Algorithms and Data Structures, Research in Computer Science, Cyber Security Essentials, Operating Systems, Object Oriented Development, Software Engineering, Database Systems, Software Architecture and Design, Software Testing and Quality, Software Production Process, and Statistical Programming.

Master in Computer Science Roosevelt University 2021 – 2022 Transfer

Software engineering, System Programming, Machine Learning, Network application development, Data mining, Information retrieval

Master in Business Administration, Concordia University Chicago U.S.A 2016- 2018 GPA 3.68

Relevant studies: Ethics Law and Comm in Decision Making, Global Marketing in the Digital Era, Managing and Leading Effective Organization, Organizational Behavior, Economics for Managers, Strategic for Innovation & Entrepreneurship, Managing Human Capital, Accounting for Decision Making, International Finance, Fundamentals of Money and Banking, Statistics Applied to Mgr. Problems, Managing Human Capital and Global Management.

Bachelor of Science, University of New York Tirana 2008 - 2014

Major in Finance

Relevant courses: Microeconomics, Macroeconomics, Investing, International Finance, Financial Statement Analysis, Principal Marketing, Principle of Management, Public Finance and Economics, Social and Economic Development, International Finance, Money and Banking, Business ethics, Corporate Finance, Business strategy and Policy.

TECHNICAL SKILLS

OS

Windows XP/7/10, Windows Server 2016/12/08, UNIX/LINUX

Databases

SQL Server 2016/14/12/08R2, Oracle 11g/8.0i, MS Access 2000/8.0, Teradata 14.0, DB2

Languages

T-SQL, PL/SQL, MDX, DAX, C#, VB.NET, XML, MYSQL, HTML, ASP.NET, .NET Frame Work, C#, C, C++, JavaScript

Web Tools

C#.Net, ASP.Net, VB.Net, Visual Studio.Net, XHTML1.0, JavaScript, VB Script

ETL & Reporting

SSDT 2016/14/12, BIDS 2008R2/08, SQL Server Integration Services (SSIS 2016/ 2014/2012/2008R2), SQL Server Reporting Services (SSRS 2016/2014/2012 /2008R2), PowerBI, SQL Server Analysis Services (SSAS)

Others

MS Office, Crystal Reports XI, Visio, Service Oriented Architecture (SOA), SQL Server Notification Services, Visual web developer, MS FrontPage, Windows Scripting Host, Erwin Data Modeler, MS Visual, SAS/Access, Crystal Reports SAP Business Objects, DataStage, Informatica, Hadoop, Micro Strategy, ER-Studio, Microsoft TFS, Microsoft GIT, MS VSS, Synergy, HP Quality Center & Jira, Master Data management, Data Quality Services

EXPERIENCE

SR Data Engineer 03/2021 - Present

(TSQL SSIS ADF SNOWFLAKE POWER BI MACHINE LEARNING ) CORB Inc., Addison, IL

●Discussed business rules surrounding data quality checks and developed efficient SQL queries to clean up data and improve data integrity.

●Strong understanding of transaction management concepts in SQL Server, including explicit transactions, isolation levels, and error handling using try-catch blocks.

●Skilled in implementing and maintaining database integrity constraints such as primary keys, foreign keys, unique constraints, and check constraints using T-SQL.

●Collaborated with cross-functional teams to gather requirements, analyze data needs, and develop T-SQL solutions that meet business objectives and ensure data accuracy.

●Proficient in troubleshooting and debugging T-SQL code to resolve data inconsistencies, performance issues, and other database-related problems.

●Created system versioned tables to store metadata about data quality rules to enable efficient tracking and data quality reporting for the business.

●Assisted in identifying and resolving deployment issues between different environments (development, testing, production) using Azure DevOps, SQL Server, and Azure Synapse Analytics.

●Designed stored procedures to hydrate dimensional models and wrote post deploy scripts for populating the static dimensional tables.

●Resolved various pipeline failures in Azure Synapse Analytics by modifying pipelines, configuring the database, optimizing stored procedures to address data mismatches, performance concerns, and other related issues.

●Developed views for Power BI usage according to the business reporting requirements, dimensional models, and security roles.

●Migrated data from Microsoft Dynamics 365 to Azure Data Lake Store to Dedicated SQL Pool through Azure Synapse Analytics.

●Created stored procedures to archive records and perform cleanup operations on stage and fact tables within the data warehouse following discussion with business analysts. Additionally, developed pipelines to deactivate the said archived records on the Dynamics side.

●Proficient in crafting and fine-tuning DAX (Data Analysis Expressions) formulas and measures to execute intricate calculations, aggregations, and advanced analytics within Power BI reports.

●Demonstrated mastery in employing data modeling methodologies within Power BI, encompassing the construction of relationships, hierarchies, calculated columns, and tables to accommodate intricate reporting needs.

●Well-versed in leveraging Power BI's data shaping functionalities, particularly through the Power Query Editor, to conduct data cleansing, transformation, and seamless integration utilizing M language for comprehensive analysis preparation.

●Proficient in optimizing SSIS package performance through comprehensive analysis of execution plans, adept identification of bottlenecks, and implementation of indexing strategies and parallelism to augment ETL efficiency.

●Experienced in orchestrating and automating SSIS package execution schedules utilizing SQL Server Agent jobs and Integration Services Catalog, ensuring precise data processing and expedited delivery.

●Demonstrated expertise in data loading and transformation processes using Snowflake's built-in features like Snowpipe for continuous data ingestion and Snowflake's data sharing capabilities for secure data exchange across organizations.

●Familiarity with Snowflake's security features, including role-based access control (RBAC), data encryption, and data masking, to ensure compliance with security standards and protect sensitive data.

●Parameterized stored procedures to enable comprehensive logging using watermarks stored in the configuration database for improved reporting capabilities and incremental load.

●Created landing and staging tables along with merge procedures to enable incremental loading and enhance data integration processes.

●Utilized XML fetch statements and implemented JSON mappings to ensure accurate extraction and ingestion of data from Dynamics into Azure Synapse.

●Conducted data backup and disaster recovery planning using AWS Backup and S3 lifecycle policies, ensuring data integrity and availability.

●Managed and optimized AWS environments for cost efficiency, achieving a 20% reduction in operational expenses.

●Designed and implemented highly available and scalable MongoDB clusters, ensuring zero downtime during peak loads.

●Optimized MongoDB queries and indexing strategies, resulting in a 50% improvement in query performance.

●Proficient in developing and implementing machine learning models using Python and libraries such as scikit-learn, TensorFlow, and Keras to solve real-world problems in classification, regression, and clustering domains.

●Experienced in all stages of the machine learning pipeline, including data preprocessing, feature engineering, model selection, training, validation, and deployment, ensuring robust and scalable solutions.

Data Engineer 06/2018 - 02/2021

(TSQL SSIS SNOWFLAKE POWER BI ADF) Johnson & Johnson, New Brunswick, NJ

●Developed complex SQL queries employing joins, subqueries, and correlated subqueries for intricate data retrieval and cross-verification purposes.

●Implemented T-SQL Scripts to validate and ascertain data integrity post-loading process, alongside modification and testing of T-SQL stored procedures.

●Acted as a developer for the Reports module utilizing MS SQL Server 2012, employing SSRS, T-SQL, scripts, stored procedures, and views.

●Proficient in Azure Data Factory (ADF) and Integration Runtime (IR), specializing in File System Data Ingestion and Relational Data Ingestion techniques.

●Executed migration of on-premise data from SQL Server to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF V2).

●Established Azure platform infrastructure for data pipelines, Azure blob storage, and data lakes, facilitating automated data flow via ADF workflows.

●Integrated structured, unstructured, and semi-structured data, including log files and media, utilizing Azure Data Factory for storage in Azure Blob Storage.

●Developed operational reports and analytical dashboards on Azure Data Warehouse using Power BI and Azure Analysis Services.

●Extracted data from various semi-structured sources, both on-premises and cloud-based, via Azure Data Factory pipelines, including CSV and JSON files.

●Utilized Databricks notebooks with Pyspark/Python/SQL to process and load data into temp tables and physical tables, optimizing storage with Parquet format and partitioning Delta tables.

●Designed semantic models for simplified analysis of business data by extracting relevant data from Azure Synapse data warehouse using Power BI.

●Assisted Project Manager in leading multi-functional project teams to implement data conversion strategies and disseminate critical information.

●Proficient in developing parameterized reports, charts, graphs, linked reports, and drill-down reports using Power BI.

●Designed and implemented reports, dashboards, and filters, incorporating various chart types, visualizations, and complex calculations in Power BI.

●Produced user-friendly and accessible reports employing interactive sorting, grouping, and formatting techniques.

●Contributed to the production of well-organized, accurate, reliable, dynamic, and insightful Power BI reports & dashboards for strategic business decision-making.

●Created and deployed SSIS packages using package installation wizard, Bids Deployment, and Management Studio Import to automate data processes.

●Designed high-level ETL architecture with SSIS for seamless data transfer from OLTP to Data Warehouse, defining ETL mapping processes.

●Prepared Parameterized reports, Cross-Tab reports, drill-down reports, Dashboard, and Summary reports utilizing SSRS.

SQL ETL POWER BI DEVELOPER 09/2015 - 05/2018

PNC Financial Services, Pittsburgh, PA

●As a significant component of the BI team, achieved successful outcomes while working with SQL, SSIS and SSRS.

●Developed ETL solutions for integrating data into the data warehouse from multiple sources like Flat Files (delimited, fixed width), Excel, SQL Server, Raw File, DB2, Oracle, and SAP.

●Performed SSIS Development and support.

●Developed SSIS Packages to extract, transfer, load (ETL) existing data into SQL Server from different environments for the SSAS cubes.

●Created complex T-SQL UDFs, CTEs, Indexed Views, Stored Procedures, and Staging Tables to process data and populate them into the appropriate destination tables.

●Developed effective SSIS packages to process Fact and Dimension tables with complex transformations and type 1 & type 2 changes.

●Created Stored Procedures for frequently used complex queries involving join and union of several tables.

●Managed the maintenance and movement of 200+ files through clearinghouse and direct connection.

●Converted old ETL packages to the new version (optimized via applying more stored procedures instead of using control flow tasks).

●Collaborated with the team/architect to implement logical/physical modeling and created Cubes (fact, dimensions, and calculations)

●Worked on various DAX expressions in Power Pivot according to the business requirements.

●Filtered and cleaned data and corrected any code issues detected by reviewing computer reports, printouts, and performance indicators.

●Produced Parameterized reports, Cross-Tab reports, drill down reports, Dashboard and Summary reports by using SSRS.

●Designed high level ETL architecture for overall data transfer from the OLTP to Data warehouse with SSIS and prepared ETL mapping processes.

SR Data Engineer

Contact this candidate