Power Bi Data Engineer

Sivakumar Vadamalai

Senior Data Engineer & Analyst

***********@*****.*********:*********.*********@*******.*** +1-302-***-**** Spring City, PA 19475 H1B

Sivakumar Vadamalai LinkedIn

Professional Summary

17+ years of IT experience with exceptional skills in analysis, design and development of high scalable multi-tiered web Applications, distributed applications and web Services by using Microsoft technologies in Chemicals & Petroleum, Consumer, Healthcare, Financials and Manufacturing industry domains.

10+ years extensive experience with cloud services (Azure, AWS, GCP), microservices, Metolian architecture, and MVC patterns. Adept at optimizing application performance, enhancing security, and fostering collaboration across cross-functional teams. Skilled in leading teams, driving Agile methodologies, and implementing CI/CD pipelines.

8+ years of experience in Microsoft Business Intelligence (BI), Data Warehousing, Data Analytics, Data Engineering, and Azure Cloud Platforms, including SQL Server, Power BI, SSIS, SSRS, and SSAS.

Expert in data integration and orchestration with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics, enabling efficient data processing and analytics at scale. Skilled in real-time data ingestion and processing using Azure Event Hubs and Azure Stream Analytics.

Proficient at managing sensitive data securely through Azure Key Vault and handling unstructured data in Azure Blob Storage and Azure Data Lake Gen 2. Experienced in developing data solutions using Python and SQL to drive data integration, transformation, and analytics at scale.

Highly experienced as a Microsoft BI Developer and Data Analyst with expertise in SQL Server 2022/2019/2016/2014/2008/2005, OLTP/OLAP, SSIS/SSRS/SSAS across various domains and environments (Production, UAT, Development).

Highly proficient in DAX (Data Analysis Expressions) for creating complex calculated columns, measures, tables, and advanced formulas for interactive Power BI dashboards and reports.

Implemented Dynamic Row-Level Security in Power BI Service (Cloud) and Power BI Report Server (On-Premises) for secure data access.

Expertise in designing Power BI composite models, aggregations, and dual storage modes for performance optimization in large-scale datasets.

Developed KPI-based reports, interactive dashboards, and analytical reports using Power BI for real-time streaming data and management-level insights.

Strong expertise in ETL Development using SSIS and ADF for extracting, transforming, and loading data from various sources, including SQL Server, Oracle, SAP, APIs and Excel/CSV into data warehouses and marts.

Proficient in Star Schema (Kimball), Snowflake modeling, and Data Marts in both OLTP/OLAP environments for Data Warehousing.

Skilled in writing complex SQL scripts (CTEs, derived tables, joins, row-numbering, sub-queries, views) for Big Data aggregation and database optimization across SQL Server, Oracle, and PostgreSQL, and IBM DB2.

Proficient in SSRS for creating Drill-Down, Parameterized, Cascading, Conditional, Ad-hoc, Sub-Reports, and Charts to support business reporting needs.

Strong experience with SSAS, building analytical cubes for multidimensional and tabular models, with proficiency in MDX and DAX for OLAP reporting.

Integrated external data sources using RESTful APIs and Web Services for data extraction and loading in Power BI.

Extensive experience in Apache Spark and PySpark for processing large datasets and integrating with Power BI for big data analytics.

Proficient in implementing Change Data Capture (CDC) and Slowly Changing Dimensions (SCD) strategies for data synchronization and historical data management in data warehouses and lakes.

Hands-on experience with Unity Catalog for centralized data governance, security, and access management across Databricks workspaces and platforms.

Experience in implementing, managing, and optimizing NoSQL databases, including CosmosDB, for high-performance, scalable, and distributed data solutions.

Led multiple projects, providing training on Power BI, DAX, M Code, and SQL, and mentoring teams on best practices in BI development.

Extensive experience in designing and implementing end-to-end solutions using Power Apps, Power Automate, Power Page, Dataverse, and Power Virtual Agents.

Adept at integrating Power Platform solutions with existing systems such as SharePoint, .NET, and SQL databases, delivering scalable and sustainable solutions that enhance business performance and improve user experience.

Technical expertise in Microsoft Technologies, such as .Net Core, .Net Framework, ASP.Net MVC, ASP.NET Web Forms, Angular, React JS, C#, VB.NET, Web Services, Web API, WCF, Web API, WPF, LINQ, IIS, SOAP, XML, ADO.NET, and Entity Framework.

Worked with JWT Security, SAML, OAuth2.0 and OpenID Connect to provide authentication and authorization.

Designed and implemented cloud-native applications using Microsoft Azure services such as App Service, Azure Functions, Azure Kubernetes Service (AKS), API Management, and Azure Logic Apps.

Proficient in End-to-End Unit Testing using frameworks such as Jasmine, Karma, NUnit, and xUnit. Extensive experience in performing Regression Testing and Integration Testing to ensure the software meets functional and performance standards.

Experience in designing, implementing, and managing CI/CD pipelines on Azure DevOps. Proficient in automating the build, test, and deployment processes, ensuring smooth, efficient, and error-free software delivery.

Technical Skills

Cloud Platform & Services: Microsoft Azure, AWS, GCP, Teradata, Azure Functions, App Services, Blob Storage, Azure Synapse, ADF, ADLS, ADMS, Azure Databricks, Azure Data Explorer, Snowflake, SaaS, DBaaS. IaaS, Docker, Kubernetes.

BI & Reporting Tools: Power BI, Tableau, DAX, Power Pages, Power Apps, Power Automate, Power Virtual Agents, MSBI (SSIS, SSAS, SSRS), QlikView, Crystal Reports 12/11, MS Excel.

Data Warehousing: Star Schema (Kimball), Snowflake Modeling, OLAP, OLTP, Database Design & Optimization.

Frameworks: .Net Core (8.0/6.0/3.0/2.0), .Net Framework (4.5/3.5/2.0), Angular (2/8/12/14), React JS 16, Node JS, Bootstrap, Entity Core Framework.

Programming Languages: Python, C#.Net, VB.Net, Visual Basic 6.0, VBA, SQL, PL/SQL, KQL.

Web Technologies: ASP.Net MVC, Asp.Net Web Forms, ADO.Net, LINQ, HTML 5, CSS 3, AJAX, XML, Kestrel, IIS.

Services: Web API, WCF, Web Services and Windows Services.

Scripts: Type Script, Java Script, jQuery, JSON

Databases: Azure SQL. MS SQL 2022/2019/2014/2008/2005, Oracle 10g/11g, 12c, Cosmos DB, MySQL, PostgreSQL, NoSQL, Dataverse, MS Access.

Testing Frameworks: nUnit, xUnit, Jasmine, Karma, Postman, Swagger

Packages: Visual Studio, Visual Studio Code, SQL Server Data Tools (SSDT), Microsoft Business Intelligence (MSBI), Power BI Desktop.

Version Control & CI/CD: Git, GitHub, TFS, VSS, VSTS, Azure DevOps, Jenkins

Education

Master of Science (MCA) Bharathidasan University • 2004 • Trichy, India

Bachelors of Science (CS) Periyar University • 2001 • Salem, India

Professional Experience

Client: Swift at Midland, Virginia

Duration: Jan 2025 - Present

Role: Senior Data Engineer & Analyst

Responsibilities:

Involved in collecting, analyzing, designing, developing, and interpreting complex data sets to drive business insights and decision-making.

Performed data manipulation, statistical analysis, data visualization and translated complex data into actionable insights, data-driven decision-making, and optimizes business process.

Designed and implemented the scalable data lakehouse on Azure Databricks, optimizing data ingestion, processing, and analysis for improved business insights.

Developed and maintained efficient data pipelines using PySpark and Spark SQL for extracting, transforming, and loading (ETL) data from diverse sources.

Built an end-to-end pipeline using DLT with Unity Catalog for secure, auditable access to sensitive business data.

Implemented Unity Catalog for centralized data governance, access control, and data lineage, ensuring data security and compliance.

Created and managed Delta Live Tables pipelines for real-time data ingestion and processing, improving data freshness and reducing operational overhead.

Connected to multiple data sources like Azure SQL Database, Databricks, Snowflake, Microsoft SQL server, MySQL, Oracle, and Teradata for importing and transforming data into Power BI as per the requirements.

Developed and maintained SQL queries and scripts for data extraction, transformation, and loading (ETL) processes using ADF.

Expertise in data preparation with experience in blending Multiple data connections and creating multiple joins across same and various other data sources.

Involved in creating relational and dimensional data modeling and develop interactive visual reports, dashboards and KPI scorecards using BI tools like Power BI and Tableau and in writing SQL Queries to extract data from data warehouses & build complex data models.

Used DAX (Data Analysis Expressions) functions for creation of calculations and measures in the Power Bi

Developed Analytical solutions by defining and translating business requirements into dashboard & reporting solutions and implementing them within confidential power Bi desktop and visualizations.

Added required measures, calculated columns by performing necessary calculations by keeping unnecessary columns hidden from reporting view in the power BI.

Implemented Facts, and Dimensions for providing summarized and aggregate views of large sets of data and used Tabular models to access them.

Performed unit testing on all the datasets and dashboards to ensure proper implementation before elevated into the production environment.

Tools Used: Azure SQL Database, Azure Databricks, Azure Data Factory, Azure Synapse, Microsoft SQL Server, My SQL, Oracle, Snowflake, Teradata, Visual Studio Code, Power BI, DAX, M Language, Power Query, Excel, Python, ETL, Cosmos DB, SQL Server Management Studio.

Client: Henkel at Los Angeles, CA

Duration: Sep 2022 - Dec 2024

Role: Senior Data Engineer & Analyst

Responsibilities:

Gathered and analyzed business requirements by collaborating with key stakeholders, including finance teams and senior management, to define the necessary metrics and KPIs for dashboards and reports.

Developed Delta Live Tables (DLT) pipelines to process and transform batch and streaming data into curated datasets across bronze, silver, and gold layers.

Leveraged Unity Catalog to manage secure access to data assets across multiple Databricks workspaces.

Designed and maintained modular Databricks Notebooks for data ingestion, transformation, and quality validation using PySpark and Spark SQL.

Built reusable Python libraries for logging, validation, and error handling in ETL workflows.

Implemented automated testing and CI/CD using Azure DevOps for Databricks Jobs and Notebook deployments.

Created data models using Tabular Editor and Power BI, ensuring the data structure was optimized for reporting and analytics while adhering to Kimball Dimensional Modeling principles.

Developed complex ETL workflows using Azure Data Factory (ADF), extracting data from multiple sources such as SQL Server, Oracle, SAP, APIs, and flat files, and loading it into the enterprise data warehouse after applying business transformations.

Leveraged SQL Server Management Studio (SSMS) to write and optimize complex SQL queries, including Common Table Expressions (CTEs), joins, sub-queries, and window functions, to prepare data for reporting in Power BI and SSRS.

Designed and deployed Power BI dashboards with dynamic and static Row-Level Security (RLS), ensuring secure access to sensitive financial data for different user groups within the organization.

Built Power BI reports from scratch using advanced DAX formulas to handle complex calculations, hierarchies, and time-based aggregations, ensuring accuracy in financial and operational reporting.

Deployed Power BI dashboards to the Power BI Service for centralized access, creating dedicated workspaces for development, QA, and production environments, ensuring seamless collaboration across teams.

Developed paginated reports using Power BI Report Builder, providing detailed and print-friendly reports that met the specific needs of the finance and compliance teams.

Utilized Tableau Desktop and Tableau Server to create interactive dashboards, reports, and visualizations, integrating data from multiple sources and providing real-time insights for executive decision-making.

Created gateways for on-premises databases, enabling seamless refreshes for Power BI reports and dashboards that relied on secure, on-premises financial data sources.

Managed Power BI administration tasks including capacity management, deployment pipelines, and user provisioning, ensuring that reports and dashboards were accessible and functioning optimally across all environments.

Worked with Power BI’s advanced visual objects such as line charts, bar charts, tree maps, KPIs, maps, custom visuals, and what-if analysis parameters, creating highly interactive and engaging dashboards.

Designed and deployed automated workflows with Power Automate to streamline communication with suppliers by automatically sending order confirmations, delivery updates, and payment reminders based on pre-defined triggers.

Developed a power app for order processing that connects with Henkel internal systems to track customer orders and status updates.

Developed RESTful Web APIs using .NET Core to integrate Power Apps and Power Automate with internal SCBI purchasing systems like feedstock, spendbaseline, and other business applications.

Tools Used: Power BI Desktop, Power BI Service, DAX, M Code, Power Pages, Power Apps, Power Automate, Power Virtual Agents, Dataverse, SSIS, SSRS, SSAS, SSMS, Azure Databricks, Azure Data Factory, Azure SQL Database, Azure Analysis Services (AAS), Azure Blob Storage, Cosmos DB, Tabular Editor, Tableau Desktop, Tableau Server, Git, Powe BI Gateways, Azure DevOps, RLS, Python, Microsoft Excel, Visual Studio Code, .Net Core, Angular, React JS, Redux, Type Script, Web API, Azure Active Directory, JWT, Azure AD.

Client: Anglian Water Services at London, UK

Duration: Sep 2018 - Sep 2022

Role: Data Engineer & Analyst

Responsibilities:

Interacted with business stakeholders, Clients and director level members for requirements gathering and presented various solutions using best practices.

Developed and maintained Databricks notebooks using PySpark and SparkSQL for data ingestion, transformation, and analysis, including complex ETL workflows.

Implemented Unity Catalog for centralized data governance, access control, and data lineage, ensuring data security and compliance.

Created and managed Delta Live Tables pipelines for real-time data ingestion and processing, improving data freshness and reducing operational overhead.

Implemented ETL processes using Azure Data Factory and SSIS to extract, transform, and load data from various sources into data warehouses.

Connected to multiple data sources like Azure SQL Database, Microsoft SQL server, MySQL, Oracle, and flat files for importing and transforming data into Power BI as per the requirements.

Developed SQL Queries, Common Table Expressions (CTE) & Sub queries for stored procedures in SQL server and performed daily testing of data using various SQL queries to support BI reports.

Involved in creating relational and dimensional data modeling and develop interactive visual reports, dashboards and KPI scorecards using BI tools like Power BI and Tableau and in writing SQL Queries to extract data from data warehouses & build complex data models.

Used DAX (Data Analysis Expressions) functions for creation of calculations and measures in the Power Bi

Developed Analytical solutions by defining and translating business requirements into dashboard & reporting solutions and implementing them within confidential power Bi desktop and visualizations.

Implemented OLAP Cubes, Facts, and Dimensions for providing summarized and aggregate views of large sets of data and used Multi-Dimensional Expressions (MDX) to access them.

Increased query performance by performing monitoring, tuning, and optimizing Indexes tasks using SQL profiler.

Developed different solution driven Power Bi dashboards with various visualizations like Scatter plot, Clustered bar Chart, Pie Chart, box plot, Sankey Chart, Donut Chart, Line & Clustered Column Chart, water fall charts, statistical models, heat maps, geo-maps. In Power BI allowing end users to utilize full functionality of the Dashboard.

Created complex dashboards using parameters, sets, groups, calculations, and drill down/up in worksheets and performed customization using filters and actions.

Managed Power BI Portal – Data refreshes / user management and set up gateway data refresh.

Created Apps to automate work orders, equipment inspections, and maintenance workflows for field staff in water recycling plants, enhancing operational efficiency and ensuring timely maintenance.

Utilized SharePoint Designer and Power Automate to develop workflows for plant inspection scheduling, ensuring that all required checks and reports were submitted and approved on time.

Tools Used: Azure Databricks, PySpark, Power BI Desktop, Power BI Service, DAX, M Code, Power Pages, Power Apps, Power Automate, Power Virtual Agents, SSIS, SSRS, SSAS, SSMS, Azure Data Factory, Azure SQL Database, Dataverse, Azure Analysis Services (AAS), Azure Blob Storage, Tabular Editor, SQL Server Data Tools, Dynatrace, Git, Powe BI Gateways, Azure DevOps, RLS, Python, Microsoft Excel, Visual Studio Code, .Net Core, Angular, React JS, Redux, Web API, JWT, Azure AD.

Client: Shell at Houston, TX

Duration: Jan 2017 - Sep 2018

Role: BI & Application Developer

Responsibilities:

Participated in agile sprint planning and reviews to ensure requirements were implemented correctly and delivered as per business needs.

Designed and deployed end-to-end data pipelines using ADF to automate ingestion from diverse sources (on-prem SQL, REST APIs, Blob Storage).

Primarily involved in Data Migration using SQL, SQL Azure, Azure storage, and Azure Data Factory, and SSIS.

Migrated existing Tableau visualizations to Power BI using Power BI Desktop, ensuring seamless integration and enhanced functionality.

Developing and Maintaining of Data Dashboards, Reports and Data Visualization tools and Products using Power BI, Tableau, and Excel.

Created complex calculated columns and measures in Power BI using DAX to address business requirements and optimize data analysis.

Created complicated DAX measures in the Power BI reports as per the requirements of the Business Users.

Developed and maintained ASP.NET Core MVC web applications using .NET Core 2.0/1.1 and Entity Framework Core, with seamless integration into Azure SQL Database for storage and retrieval of business-critical data.

Developed responsive user interfaces with Angular 2, Bootstrap and JavaScript, integrating them with ASP.NET Core Web APIs to provide rich, dynamic user experiences.

Created RESTful APIs using ASP.NET Core to facilitate communication between front-end and back-end services, ensuring efficient data flow and system integration.

Integrated Azure SQL for data storage, Azure Blob Storage for storing and serving customer documents, and Web APIs for data interactions.

Worked with SAML 2.0 for implementing Single Sign-On (SSO) to authenticate users with corporate identity providers and securely grant access to enterprise applications.

Implemented Azure SendGrid for scalable email delivery, improving reliability and performance of email notifications in cloud-based applications.

Deployed applications to Azure App Services, configuring continuous integration/continuous deployment (CI/CD) pipelines for streamlined production updates.

Developed stored procedures, user defined functions, views, triggers, T-SQL scripting for complex business logic.

Designed, developed, modified, and enhanced the database structures and database objects.

Tools Used: Microsoft Azure, Azure App Service, Azure Blob Storage, Azure SendGrid, .Net Core 2.0/1.1, C#, ASP.NET MVC, Web API, WCF, Angular 2, Bootstrap, HTML, CSS 3, jQuery, JavaScript, XML, Visual Studio 2017, TFS, Entity Framework, Azure SQL, SAML 2.0, Power BI Desktop, Tableau Desktop, Azure Data Factory, Azure Storage. DAX.

Client: L'Oreal USA at New York, NY

Duration: Dec 2014 - Dec 2016

Role: MSBI Developer

Responsibilities:

Designed ETL packages dealing with different data sources (SQL Server, Flat Files, and XMLs etc.) and loaded the data into target data sources by performing different kinds of transformations using SQL Server Integration Services (SSIS).

Worked with SSIS for ETL process ensuring proper implementation of Event Handlers, Loggings, Checkpoints, Transactions, and package configurations.

Deployed and uploaded the SSRS reports to Report manager and called reports through a URL from .Net API for the end users and involved in enhancements and modifications.

Created databases and schema objects including tables, indexes, and applied constraints, connected various applications to the database and written functions, stored procedures, and triggers.

Proficient in usage of SSIS Control Flow items (For Loop, executes package/SQL tasks, Script task, send mail task) and SSIS Data Flow items (Conditional Split, Data Conversion, Fuzzy lookup, Fuzzy Grouping, Pivot).

Designed, Developed & Delivered web application using ASP.Net MVC, C#, VB.Net, LINQ, Web Services.

Developed the application using C#.NET to incorporate business logic & implemented back-end connectivity using ADO.NET.

Utilized AJAX to implement asynchronous communication for real-time user experience without page reload.

Wrote optimized SQL queries, stored procedures, and designed database schemas in SQL Server to handle complex data transactions.

Integrated LINQ for querying databases, improving code readability and performance.

Integrated jQuery to manipulate the DOM, handle events, and facilitate client-side validation and interaction.

Created and consumed RESTful APIs for seamless data exchange between front-end and back-end services.

Implemented web security principles such as input validation, SQL injection prevention, authentication, and authorization.

Tools Used: .Net Framework 4.0/4.5, C#, VB.NET, ASP.NET, MVC, WCF, Web Services, HTML, CSS 3, jQuery, JavaScript, AJAX, XML, SSIS, SSAS, SSRS, Visual Studio 2012/2015, TFS, SQL Server 2012, SQL Server Data Tools, Oracle 10g, MS Access, MS Excel.

Client: Jones Lang LaSalle at Leeds, UK

Duration: Mar 2010 - Nov 2014

Role: MSBI Developer

Responsibilities:

Developed and executed Extract, Transform, Load (ETL) processes using SQL Server Integration Services (SSIS), extracting data from diverse sources such as Excel, flat files, SQL Server and Oracle databases.

Extracted large volumes of data from various data sources and loaded the data into target data sources by performing kinds of transformations using SSIS.

Created and maintained SQL Server databases, writing custom T-SQL stored procedures and triggers to enhance application performance and enforce referential integrity across data structures.

Conducted data cleansing and transformation using SSIS, implementing data quality checks to ensure the accuracy of critical information before it was loaded into target databases.

Designed and deployed SSRS reports, including parameterized reports, drill-down and drill-through reports, to provide stakeholders with insights into business performance metrics.

Created complex stored procedures in T-SQL to generate ad hoc reports within SQL Server Reporting Services, allowing users to perform flexible analyses on demand.

Utilized SQL Profiler and the Database Engine Tuning Advisor to optimize SQL queries and stored procedures, significantly enhancing database performance and reducing execution times.

Documented all database processes, ETL workflows, and report designs to ensure knowledge transfer and ease of maintenance for future projects.

Design, Develop & Deliver applications using .NET Framework 3.5, C#, ASP.NET, ADO.Net, Java Script, jQuery, AJAX, HTML, CSS, Web Services, Windows Services & SQL Server.

Developed and deploy web services, WCF services and consume them in the client application.

Performed performance testing on QlikView applications to ensure fast data loading and smooth rendering of dashboards for large datasets.

Coordinated with the IT team to configure and maintain the QlikView Server, ensuring the smooth operation of QlikView applications in the production environment.

Tools Used: .Net Framework 3.5/2.0, C#, ASP.NET, WCF, Web Services, Windows Services, HTML, CSS 3, jQuery, JavaScript, AJAX, XML, SSIS, SSAS, SSRS, QlikView 11, Crystal Report 11/12, Visual Studio 2010/2012, TFS, SQL Server 2005/ 2008 R2, Oracle 9i, IBM DB2, MS Access, MS Excel.

Client: Nike at Bengaluru, India

Duration: Jan 2008 - Mar 2010

Role: Application Developer

Responsibilities:

Design, Develop & Deliver applications using .NET Framework 2.0, C#, ASP.NET, ADO.Net, Java Script, jQuery, AJAX, HTML, CSS, Web Services, VBA & SQL Server.

Used AJAX to improve UI responsiveness and reduce page reloads.

Created data-driven web pages and reports using ADO.NET and SQL Server.

Implemented user-friendly interfaces with client-side JavaScript and AJAX.

Used AJAX to improve UI responsiveness and reduce page reloads.

Provided technical support for Access-based tools and legacy Excel VBA systems.

Integrated complex SQL Server stored procedures and optimized T-SQL queries.

Utilized SQL Profiler and the Database Engine Tuning Advisor to optimize SQL queries and stored procedures, significantly enhancing database performance and reducing execution times.

Tools Used: .Net Framework 2.0, C#, ASP.NET, Web Services, Windows Services, HTML, CSS 3, JavaScript, AJAX, XML, TFS, SQL Server 2005, VBA, MS Access, MS Excel.

Contact this candidate