Azure Data Engineer

Azure Data Engineer

875**-*****

Professional Experience

Freelancer Azure Data Factory Remote 1/2020 – Present

Key Responsibilities:

Developed and monitored Azure Data Factory (ADF) pipelines to automate ETL processes and ingest data from on-premises SQL Server to Azure SQL Database.

Implemented Copy Activity and Mapping Data Flows in ADF for efficient data movement and transformation.

Created and optimized SQL queries for data extraction, validation, and performance tuning.

Designed Stored Procedures to automate data cleansing and aggregation tasks.

Integrated Azure Blob Storage for staging raw data before loading into Azure SQL.

Collaborated with cross-functional teams to understand data requirements and deliver solutions.

Designing dynamic pipelines and datasets as reusable components using configuration table and pipeline parameters.

Deployed ADF pipelines using Azure DevOps CI/CD pipelines for automated deployment across environments.

Key Achievements:

Reduced manual data processing time by 40% through automated ADF workflows.

Improved SQL query performance by optimizing joins and indexing strategies.

Successfully migrated 50 GB of data from on-premises to Azure SQL.

Project Experience

Project 1: Automated Data Integration using Azure Data Factory

Tools: Azure Data Factory, Azure SQL Database, SQL Server, Azure Blob Storage

Project Description:

Developed ADF pipelines to automate data extraction from on-premises SQL Server into Azure SQL Database.

Configured Copy Activity for incremental data loads and used Stored Procedures for data transformation.

Stored raw data in Azure Blob Storage for backup and historical analysis.

Scheduled ADF pipelines using Triggers to automate daily ETL processes.

Key Results:

Reduced ETL processing time from 3 hours to 45 minutes.

Enhanced data accuracy through validation checks during pipeline execution.

V.DHIVYAPRIYA

PROFESSIONAL SUMMARY

Detail-oriented Azure Data

Engineer with 5 years of

experience in implementing and

managing Azure Data Factory(ADF)

pipelines and working with SQL

Server databases. Skilled in ETL processes,

data transformations, and

performance optimization. Proven

ability to work in collaborative teams

to deliver reliable and scalable

cloud data solutions

TECHNICAL SKILLS

Cloud Tools: Azure Data Factory (ADF), Azure SQL Database, Azure Blob Storage

Databases: SQL Server, Azure SQL,

ETL & Data Management: ADF Pipelines, Data Flows, Data Movement, Stored Procedures

Programming Languages: SQL, Python (basic)

Version Control: Git, Azure DevOps

LANGUAGES

Tamil(Native)

English

EDUCATION

Bharathidasan University(Trichy)

MCA - 2011-2014

BCA - 2008-2011

V.DHIVYAPRIYA

PROFESSIONAL SUMMARY

Detail-oriented Azure Data

Engineer with 5 years of

experience in implementing and

managing Azure Data Factory(ADF)

pipelines and working with SQL

Server databases. Skilled in ETL processes,

data transformations, and

performance optimization. Proven

ability to work in collaborative teams

to deliver reliable and scalable

cloud data solutions

TECHNICAL SKILLS

Cloud Tools: Azure Data Factory (ADF), Azure SQL Database, Azure Blob Storage

Databases: SQL Server, Azure SQL,

ETL & Data Management: ADF Pipelines, Data Flows, Data Movement, Stored Procedures

Programming Languages: SQL, Python (basic)

Version Control: Git, Azure DevOps

LANGUAGES

Tamil(Native)

English

EDUCATION

Bharathidasan University(Trichy)

MCA - 2011-2014

BCA - 2008-2011

Contact this candidate