Azure Data
Resume:
Miteshkumar Patel
adlmkj@r.postjobfree.com
SUMMARY:
Experience on Migrating SQL database to Azure data Lake, Azure data lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and Controlling and granting database access and Migrating On premise databases to Azure Data lake store using Azure Data factory.
Experience in Developing Spark applications using Spark - SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
Good understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks.
Experience in Database Design and development with Business Intelligence using SQL Server 2014/2016, Integration Services (SSIS), DTS Packages, SQL Server Analysis Services (SSAS), DAX, OLAP Cubes, Star Schema and Snowflake Schema.
Excellent communication skills with excellent work ethics and a proactive team player with a positive attitude.
Experience to work with Synapse.
Strong skills in visualization tools Power BI, Confidential Excel - formulas, Pivot Tables, Charts and DAX Commands.
Expertise in various phases of project life cycles (Design, Analysis, Implementation, and testing).
SKILLS:
Azure Data lake, Data factory, Synapse
Azure Databricks, Azure SQL database, Azure SQL Datawarehouse
Programming Scala, Python, Spark SQL
MSBI (SSIS, SSAS, SSRS)
Data Visualization
Data Migration
SQL Server programming
Confidential Power BI
Analytic Problem-Solving
Network Routing.
Certification:
Azure 900 – Azure Fundamentals Certification
Azure 201- Azure Developer Advanced Solutions
PROFESSIONAL EXPERIENCE:
Neuberger Berman. Aug 2017 Till Date
Azure Data Engineer
Hands on experience troubleshooting, configuring Azure services like Azure Data factory, Azure Data Lake
Used Azure Data Factory V2 to Pause and Resume Azure SQL Data Warehouse.
Implemented Copy activity, Custom Azure Data Factory Pipeline Activities.
Developed the pipelines in Azure Data factory for various scenarios to meet business requirement using blob storages and ingesting the data into azure synapse analytics.
Processed the fixed width files using derived column activity and loaded into ADLS/ azure synapse analytics using copy activity.
Designed SSIS Packages to transfer data from flat files, Excel SQL Server using Business Intelligence Development Studio.
Created SSIS packages to implement error/failure handling with event handlers, row redirects, and loggings.
Designed complex data intensive reports in Power BI utilizing various graph features such as gauge, funnel.
Developed Spark scripts by using Scala shell commands as per the requirement.
Created Azure key vault for storing connection string details, certificates and used the key vaults in Azure Data factory while creating linked services.
Developed logic apps to trigger email notification whenever the pipeline got failed using web activity.
Working Experienced with Azure logic apps to schedule, automate, and orchestrate tasks.
Worked on POC’s with Apache Spark using Scala to implement spark in project.
Self-hosted integration runtime has been created to copy the files form On-premises VM using various activities like metadata, foreach and copy and loaded into ADLS GEN2 and azure synapse analytics.
Having experienced in PowerShell scripts for automation of pipelines.
Involved in performance tuning of pipelines in Azure Data factory.
Created data frames for reading and writing the various file formats in notebooks using data bricks.
Debugging the code with various testcases and deploying the code into various higher environments with azure devops using CI/CD pipelines.
Experienced in working on DevOps /Agile operations process and tools area (Code review, unit test automation, Build & Release automation Environment, Incident and Change Management) including various tools.
Having experienced in Power BI for generating reports and dashboards.
Mintex Tech Inc – Edison, NJ Aug 2015 to Aug 2017
SQL Server Engineer
Generated complex stored procedures and functions for better performance and flexibility.
Designed logical and physical database structure to facilitate analysis of data from both operational and customer perspectives.
Responsible for creating Databases, Tables, Cluster/Non-Cluster Index, Unique/Check Constraints Views, Stored Procedures, Triggers, Rules and Defaults.
Creating functions and developing procedures for implementing application functionality at the database side for performance improvement.
Built and maintained SQL scripts, indexes, and complex queries for data analysis and extraction.
EDUCATION:
Master of Engineering in Computer Science from Stratford University VA.
Contact this candidate