Azure Data Power Bi
Resume:
Satheesh Ph: - 603-***-****
SQL MSBI/Data Engineering Email: ***************@*****.***
PROFESSIONAL SUMMARY:
I have 10+ Years of MS SQL Server Development Experience in Finance, Manufacturing & Distribution, Gaming, Healthcare/Insurance Industry and Excellent knowledge about health care industry and claims management with expertise in MS SQL Server 2005/2008/2008R2/2012/2016/2017 and Microsoft’s suite of products like SSIS, SSAS, and SSRS. I have a strong analytical approach to business analysis and management.
Handles multiple assignments simultaneously and successfully identify and coordinate key deliverables with stakeholders in cross-functional groups. Passions include ensuring data quality, scalability, performance, integrity, and security, as well as standards development and process improvement
Technically and logically very sound in T-SQL Programming, SSIS, SSRS, SSAS, .NET, Data warehousing, Business Intelligence etc.
Loaded the tables from the DWH to Azure data lake using azure data factory integration run time and loaded the tables from the azure data lake to azure blob storage for pushing them to snowflake.
Developed and maintained CI/CD pipelines using Azure DevOps to automate the deployment of data processing workflows, utilizing Azure Data Factory for orchestration and Azure Databricks for real-time data processing and transformation.
Automated the deployment of PySpark jobs in Azure Databricks via Azure Data Factory, enabling seamless scheduling and monitoring of ETL pipelines from data ingestion to transformation and storage in Azure Data Lake.
Created Power BI Reports using the Tabular SSAS models in Power BI desktop with DAX queries and published them to Power BI Service using star schema.
Scheduled and maintain packages by daily, weekly and monthly using SQL Server Agent in SSMS.
Implemented automated data validation and unit tests for PySpark code within CICD pipelines, ensuring that ETL jobs in Azure Databricks process data correctly before deployment to Azure Data Lake.
Integrated Git with Azure Databricks to manage code versions of notebooks, ensuring proper version control for PySpark scripts and seamless collaboration across data engineering and data science teams.
Worked on T-SQL programming, stored procedures, user-defined functions, cursors, views setup and management of linked servers to Non-SQL-Server databases.
Experienced in Agile, Waterfall, Rapid Application Development (RAD), Gap Analysis, Microsoft Project, Microsoft SharePoint, End User Training.
Experience converting Teradata/Netezza code to Azure Synapse. Converting the scripts to Azure Synapse stored procedures & defining them Via ADF Pipeline. Scheduling the jobs using triggers in Azure Data Factory.
Worked on Databricks Delta tables and Notebook for transforming Store Procedures to Notebook Scripts.
Build Pipelines in Azure Data Factory with Scheduled triggers set up
Strong ability in defining query for generating drill through, drill down reports, canned and cache reports with drop down menu option, sorting the data, defining subtotals and handling parameterized reports and creating report layouts using SSRS 2005/2008.
Experience in developing Custom Reports and different types of Tabular Reports, Matrix Reports, Ad hoc reports and distributed reports in multiple formats using SQL Server Reporting Services (SSRS) in Business intelligence development studio (BIDS).
Sound knowledge of Performance Tuning, Disaster Recovery, Backup and Restore procedures.
Education: Bachelor’s in Computer Science (JNTUK), INDIA
TECHNICAL SKILLS:
RDBM/Databases:
MSSQL Server 2000/2005/2008/2012/2014/2016/2017, MS Access 97/2000/2003/2007, MYSQL. Oracle 12c/11g/10g/9i
Programming Languages:
T-SQL, PL/SQL, Dynamic SQL, MDX, XML, HTML, DHTML, Shell Scripting, Visual Basic 6.0, PySpark.
Data Modeling:
MS Visio, Fact & Dimensions tables, Physical & Logical data modeling, Star & Snowflake schema Relational, Dimensional and multidimensional modeling and De-Normalization Techniques, MS- Access.
ETL-Tools:
SQL Server Integration Services (SSIS), Azure Data Factory, Azure Databricks
BI Tools:
SQL, SQL Server Integration Services (SSIS 2005/2008/2012), SQL Server Reporting Services (SSRS 2005/2008/2012) SQL Server Analytical Services (SSAS 2005/2008/2012), Agile Methodology, Power BI Visual Studio, BIDS.
Tools/Database Utilities:
SQL Server Management Studio, SQL Server Enterprise Manager, SQL Server Profiler, Import & Export Wizard, Visual Studio .Net, Microsoft Management Console, Business Intelligence Development Studio (BIDS), Toad, IIS 6.0/7.0, Business Objects, Crystal Reports 9.0, Web Services,Azure Data Factory, Azure Databricks XML, SOAP, WSDL, UDDI, Clear Case, Clear Quest, Visual Source Safe 6.0/2005, Visual Studio Team Foundation Server (TFS).
Professional Experience:
Client: Nestle Purina Oct 2021 – Present
Location: St.Louis, MO
Role: SQL Data Engineer
Responsibilities:
Provided database and day-to-day to support of MS SQL Server databases, including backup and recovery procedures, database utilities, and data replication technologies while supporting the development, test, and production environments.
experience in Data Analysis, Development and Support of Business Intelligence using Power BI, SQL Server, SSAS, SSIS and SSRS, Microsoft Azure platforms.
Designed and implemented ETL pipelines with PySpark on Azure Databricks, automating the extraction, transformation, and loading of data from various cloud sources to Azure Data Lake and Azure SQL Database.
Leveraged PySpark in Azure Databricks to execute distributed data operations and parallel processing, significantly improving computation speed for large-scale data analytics.
Developed and maintained CICD pipelines for Azure Databricks notebooks, automating the deployment of production-ready data processing and machine learning models using Azure DevOps and Git integration.
In-Depth understanding of Snowflake Cloud technology, snowflake multi-cluster and credit Usage
Experience in Virtual Warehouse, Performance tuning Snow SQL queries.
Establish Import connection to store the data source in the Power BI and creating measures using DAX, creating parameters, changing columns name to make them more user-friendly.
Created complex measures using DAX and made Performance analysis.
Used an M code for Data Modeling in Power Query using Power BI
Created Power BI Reports and effective Visualizations on Import Connection and published to Power BI Service.
Created SSIS packages to Extract, Transform and load (ETL) data from Excel, Database, XML File and Flat file source by using different SSIS transformations such as Lookup, Derived Columns, Condition Split, Aggregate, Pivot Transformation, and Slowly Changing Dimension, Merge Join and Union all.
Updating statistics and rebuilding the fact tables & look up tables via Azure Synapse Stores procedure & scheduling them using triggers during the Non Business hours.
Design and implement ETL solutions using ADF V2 Azure-SSIS IR.
Architect and implement ETL and data movement solutions using Azure Data Factory Pipelines
Transformed Store Procs to Databricks Notebooks and create Delta tables in Databricks.
Designed and Developed Database Objects like Tables, Stored Procedures, Triggers, Rules, Defaults, user defined data types and functions for this project.
Environment: SQL Server 2016/2018, SSIS, SSAS, MS Excel, SQL Profiler, T-SQL, Power BI desktop, Power BI Service, Power BI Gateway, Visual Studio, Azure Devops, Git Source control, Spark Sql, Synapse ADLS, Azure Blob Storage, Azure Databricks, Azure Data Lake, Azure Data Factory, SQL Azure, SQL
Client: U.S. XPRESS Oct 2020 – Oct 2021
Location: Chattanooga, TN
Role: BI Developer
Responsibilities:
Employed Power BI to rapidly prototype/pilot each BI solution and to enhance business
requirements gathering and satisfaction within iterative cycles, before recreating successful Power BI models using SSAS Tabular for support of enterprise hybrid Power BI solutions.
Created security model using SSAS Tabular Model (DAX), using GitHub (Azure Devops) as source control.
Prepare ETL mapping to extract data from multiple source systems to target system and combine the data and perform data flow and data transformation using SSIS.
Migration of existing SQL server database to Azure SQL database.
Managed the entire SSIS ETL process involving the access, manipulation, analysis, interpretation and presentation of information from both internal and secondary data sources to end users.
Experience working on Python, Databricks, Spark & Synapse warehousing.
Created Power BI App for global sales management teams and created security levels in service.
Migration of on premise data (Oracle/ SQL Server/ DB2/ MongoDB) to Azure Data Lake Store(ADLS) using Azure Data Factory(ADF V1/V2).
Worked on DBT (ELT tool) connection setup with snowflake and have used DBT cloud to execute ELT pipelines in snowflakes.
Worked on writing, testing, debugging SQL code for transformations using data build tools (DBT).
Implemented snowflake continuous data loading, snowflake time travel & fail-safe and secured data sharing.
Strong experience in writing scripts using Python API, PySpsark API and Spark API for analyzing the data.
Hands - on use of Spark and Scala API's to compare the performance of Spark with Hive and SQL, and Spark SQL to manipulate Data Frames in Scala.
Expertise in Python and Scala, user-defined functions (UDF) for Hive and Pig using Python.
Created Measures in Tabular Model using DAX and multiple hierarches.
Experience in working with SSAS Tabular model to produce reports in Power BI and DAX queries.
Wrote user requirement documents and developed functions, indexes, stored procedures, views and triggers for automation. Converted fast views in to EUP views and validated data.
Design and implement ETL solutions using ADF V2 Azure-SSIS IR.
Hands-on experience Relational Database Modeling and Dimensional Modeling in combination with SSAS to develop OLAP cubes having Star/Snowflake schemas.
Expertise in design of ETL packages for integrating data from heterogeneous sources like (Excel, Flat file, CSV) by using multiple transformations provided by SSIS.
Environment: SQL Server 2016/2017, SSIS, SSRS, SSAS, MS Excel, SQL Profiler, T-SQL, Power BI desktop, Power BI Service, Power BI Gateway, Visual Studio, Azure Devops, Git Source control, Spark SQL, Synapse, ADLS, Azure Blob Storage, Azure Databricks, Azure Data Lake, Azure Data Factory, SQL Azure, SQL
Client: BOYD Gaming July 2019 – Oct 2020
Location: Las Vegas, NV
Role: SQL BI Developer
Responsibilities:
•Created complex Stored Procedures and Functions to support the front-end application.
•Participated in developing logical model and implementing requirements on SQL Server 2017.
•Created Indexes, Views, Triggers, Stored Procedures and Packages in T-SQL.
•Created database triggers to implement business requirements.
•Utilized PySpark with Delta Lake to perform efficient batch processing, ensuring data consistency and enabling time travel for rollback and versioning of large datasets.
•Integrated Git with Azure Databricks to manage code versions of notebooks, ensuring proper version control for PySpark scripts and seamless collaboration across data engineering and data science teams.
•Involved in tuning the database and T-SQL queries using Explain Plan.
•Optimize SQL queries for improved performance and availability.
•Designed and implemented ETL pipelines with PySpark on Azure Databricks, automating the extraction, transformation, and loading of data from various cloud sources to Azure Data Lake and Azure SQL Database.
•Advanced calculations using DAX (Aggregate, Date, Logical, String, Table)
•Deployed Power BI Reports to the Cloud and set permissions to the business users to access.
•Performed Bulk data migration using DTS and SSIS from flat files.
• Worked on Power BI and created reports and dashboards and published them on service.
•Designed and optimized all the SSIS packages and exported data from text file to SQL Server Database.
•Design and implement ETL solutions using ADF V2 Azure-SSIS IR .
•Create ARM templates to deploy and maintain various Azure services through CI/CD processes.
•Experienced in Developing Power BI Reports and Dashboards from multiple data sources using Data Blending and DAX in Power Query.
•Compare the structure in source and target using Redgate.
•Worked with Quality assurance to develop test plans and test cases to conduct system testing.
•Involved in performance tuning of the database and T-SQL queries.
•Preparation of project documentation.
•Preparation of test plans for assembly testing & System Integration testing.
•Developed Reports to generate daily, weekly, monthly, quarterly, yearly Reports using Crystal Reports.
Environment: SQL Server 2017, SSIS, SSRS, DB2, ODBC, VBScript, Windows 10, Azure Databricks, Azure Data Factory, Azure Datalake, Azure Devops, Power BI Desktop, Power BI Cloud, Redgate
Client: Farm Credit Services of America Mar 2019 – July 2019
Location: Omaha NE
Role: SQL BI Developer
Responsibilities:
Provided database and day-to-day to support of MS SQL Server databases, including backup and recovery procedures, database utilities, and data replication technologies while supporting the development, test, and production environments.
Experienced and Created logs for ETL load at package level and task level to log number of records processed by each package and each task in a package using SSIS 2012,2014
Configured SSIS Packages using Environment Variables for Dynamic selection of Development and Production Environment.
Developed, tested, and took into production end-to-end hybrid Power BI solutions that sat atop an on-premise SSAS Tabular environment, while also drawing upon a data mart I designed, containing several diverse enterprise data sources, including SQL Server, Oracle.
Worked on Service now Tickets to get SQL DML Scripts and executed in Production Environment.
Worked on DAX query to create dynamic measures on Power BI Desktop.
Worked on Power BI Dashboard to make some changes on behalf of Business and functional requirements.
Created and Executed Dynamic SQL Script to Update and Delete the rows and Columns in tables.
To meet business requirements and to coordinate user testing, worked closely with users.
Used DDL and DML for writing triggers, stored procedures, and data manipulation and created views to restrict access to data in a table for security.
Designed and Developed Database Objects like Tables, Stored Procedures, Triggers, Rules, Defaults, user defined data types and functions for this project.
Monitored and Scheduled SQL Agent Jobs to execute SSIS Packages.
Environment: SQL Server 2012/2016/2017, SSIS, MS Excel, SQL Profiler, Agile Methodologies, Service now T-SQL, Power BI Service, Power BI Desktop, Visual Studio 2016/2017
Client: Boston Beers Co Oct 2018 – Mar 2019
Location: Boston, MA
Role: SQL BI Server Developer
Responsibilities:
Employed Power BI to rapidly prototype/pilot each BI solution, and to enhance business
requirements gathering and satisfaction within iterative cycles, before recreating successful Power BI models using SSAS Tabular for support of enterprise hybrid Power BI solutions.
Created security model using SSAS Tabular Model (DAX), using GitHub (Azure Devops) as source control.
Developed and deployed SSIS packages in Production Server.
Managed the entire ETL process involving the access, manipulation, analysis, interpretation and presentation of information from both internal and secondary data sources to end users.
Expertise in using Microsoft Reporting Service (SSRS) with Report authoring, Report management, Report delivery and Report security.
Participate in implementing initial POC to migrate to Azure and implementation thereafter.
Implement virtual networks to connect cloud services through virtual machines using Azure load balancer.
Experience in creating jobs, SQL Mail, Alerts and schedule SSIS Packages using SQL Server Agent.
Strong ability in defining query for generating drill through, drill down reports, canned and cache reports with drop down menu option, sorting the data, defining subtotals and handling parameterized reports and creating report layouts using SSRS.
Deployed Reports created Report schedules and subscriptions. Managing and securing reports using SSRS Report Manager.
Created Measures in Tabular Model using DAX and multiple hierarches.
Experience in working with SSAS Tabular model to produce reports in Power BI and DAX queries.
Hands-on experience Relational Database Modeling and Dimensional Modeling in combination with SSAS to develop OLAP cubes having Star/Snowflake schemas.
Expertise in design of ETL packages for integrating data from heterogeneous sources like (Excel, Flat file, CSV) by using multiple transformations provided by SSIS.
Environment: SQL Server 2016/2017, SSIS, SSRS, SSAS, MS Excel, SQL Profiler, T-SQL, Power BI desktop, Power BI Service, Power BI Gateway, Visual Studio, Azure Devops, Git Source control.
Client: Monsanto Jan 2018 – Sep 2018
Location: St. Louis, MO
Role: SQL Power BI Developer
Responsibilities:
Provided day-to-day to support of MS SQL Server, Power BI including backup and recovery database utilities, and data replication technologies while supporting the development, test, and production environments.
Created Power BI Reports using the Tabular SSAS models in Power BI desktop and published them to Power BI Service using star schema.
Performed Bulk data migration using DTS and SSIS from flat files.
Designed and optimized all the SSIS packages and exported data from text file to SQL Server Database.
Establish Import connection to store the data source in the Power BI and creating measures using DAX, creating parameters, changing columns name to make them more user-friendly.
Developed, tested, and took into production end-to-end hybrid Power BI solutions that sat atop an on-premise SSAS Tabular environment.
Created Dimensions and cubes with star schema using SQL SERVER Analysis Services (SSAS) using SQL SERVER DATA TOOLS 2015.
Publish Power Bi reports to the Power BI service with client credentials, so it will be accessible to end users.
Added data sources to Power BI Gateway and map users to the data source and created workspace in Power BI service after that add admins and members. So, everyone can access those Power BI reports in Power BI Service and create dashboards.
Created various charts like Pie Charts and Line Charts to make easy understanding of the reports.
Environment: SQL Server 2016/2017, SSIS, SSAS, MS Excel, SQL Profiler, T-SQL, Power BI desktop, Power BI Service, Power BI Gateway, Visual Studio.
Client: Xchange Worx Aug 2015 – Dec 2017
Location: Albany, NY
Role: SQL Power BI Developer
Responsibilities:
Provided database and day-to-day to support of MS SQL Server databases, including backup and recovery procedures, database utilities, and data replication technologies while supporting the development, test, and production environments.
Created Power BI Reports and effective Visualizations on Import Connection and published to Power BI Service.
To meet business requirements and to coordinate user testing, worked closely with users.
Worked on to Create new database/tables to put in the extracted data and rebuild the relationship.
Responsible for updating and maintaining various system tables through QNXT including the following modules: Benefits, Contracts, Claims, Configuration, Carriers/Programs, Fee Schedules, Medical Codes, Policy Administrator, Providers, and Utilization Management.
Created various reports like Tabular reports and Matrix reports in Power BI.
Created Multiple Store Procedures using Dynamic SQL to manipulate the data into the tables.
Establish Import connection to store the data source in the Power BI and creating measures using DAX, creating parameters, changing columns name to make them more user-friendly.
And live connection directly from data sources without physically storing them in Power BI and visualized the data in summarized detailed, ad-hoc reports, Pie charts, graphs, drill-through reports, tabular reports with other visualizations and create reports.
Publish Power Bi reports to the Power BI service with client credentials, so it will be accessible to end users.
Added data sources to Power BI Gateway and map users to the data source and created workspace in Power BI service after that add admins and members.
Created various charts like Pie Charts and Line Charts to make easy understanding of the reports.
Environment: SQL Server 2016, MS Excel, SQL Profiler, ETL, QNXT, T-SQL, Power BI, Power BI Service, Power BI Gateway, MS SQL Server Integration Services, MS SQL Server Analysis Services, Visual Studio.
.
Client: Microware Tech May 2013 – June 2015
Location: Hyderabad, India
Role: SQL/SSIS/SSRS Developer
Responsibilities:
•Created complex Stored Procedures and Functions to support the front-end application.
•Participated in developing logical model and implementing requirements on SQL Server 2008/2005.
•Created Indexes, Views, Triggers, Stored Procedures and Packages in T-SQL.
•Created database triggers to implement business requirements.
•Successfully created schema change scripts to existing objects to synchronize with changing business rules.
•Monitored growth of database objects for capacity planning.
•Created ETL packages in SSIS to load the Production tables.
•Scheduled jobs in SSIS Server and monitored as daily activity.
•Involved in tuning the database and T-SQL queries using Explain Plan.
•Optimize SQL queries for improved performance and availability.
•Configured and monitored database application.
•Worked with Quality assurance to develop test plans and test cases to conduct system testing.
•Involved in performance tuning of the database and T-SQL queries.
•Preparation of project documentation.
•Preparation of test plans for assembly testing & System Integration testing.
•Developed Reports to generate daily, weekly, monthly, quarterly, yearly Reports using Crystal Reports.
Environment: SQL Server 2008/2005, SSIS, SSRS, DB2, Oracle 9i, ASP, ODBC, VBScript, Windows 2000/XP, IIS 5
Contact this candidate