Post Job Free
Sign in

Data Engineer Azure

Location:
Columbia, TN
Posted:
June 27, 2023

Contact this candidate

Resume:

ANGELA SUKWE

SPRING HILL, TN

240-***-****

*********@*****.***

PROFESSIONAL EXPERIENCE

Keen Solution LLC

Clarksville TN

Azure Data Engineer (Freelance) January 2022 –present

■ Automated Data migration process (ETL) between systems by setting up triggers

■ Transformed data using data flows in Azure Data Factory and loaded into ADLS Gen 2.

■ Performed general data ingestion from different sources.

■ Evaluated and improved data governance policies and procedures.

■ Worked with cross-functional teams to devise data security protocols, ensuring sensitive data is always protected.

■ Ingesting Data from on-premise SQL

■ Ingesting Data from the on-premise MySQL server to the Azure SQL server

■ Ingesting s3 data into Blob and using Data-flow to populate SQL tables.

■ Build Mapping Data-flows in ADF

■ Install Azure Data Factory self-hosted integration runtime to ingest from on-premises data.

■ Using Triggers in Azure Data Factory (ADF) to schedule the data pipelines.

■ Transform data using Data Flows in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

■ Ingest data from sources such as REST API Azure Blob Storage into Azure Data Lake Gen2 using Azure Data Factory (ADF)

■ Copied Data into a Dedicated SQL pool using the bulk copy technique.

● Ingesting data into the Data Lake Storage (Gen2) using Microsoft Azure Storage Explorer

● Setting up Azure Data Lake Gen2 for external query

● Setting up external tables from ADLS Gen2

● Build Mapping Data-flows in ADF

Omega Services, INC

SpringHill, TN

Azure Data Engineer May 2022– March 2023

■ Ingested data into the ADLS Gen 2 using Microsoft Azure Storage Explorer.

■ Ingested data from sources.

■ Install Azure Data Factory self-hosted integration runtime to ingest from n-premises data.

■ Using Triggers in Azure Data Factory (ADF) to schedule the data pipelines.

■ Transform data using Data Flows in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

■ Monitoring production workloads

■ Escalating incidents

■ Debugging pipelines

■ Rerunning Pipelines from Failure

■ Wrote SQL statements for retrieval of data and was involved in performance tuning of SQL

■ Debugged errors and re-running ETL ADF pipelines. Loaded Data warehouse tables using bulk copy into command.

■ Leverage industry-leading integration analytics tools to build a modern data warehouse that is accurate, high-performance, and accessible to our business department.

■ Debugged errors and re-running ETL ADF pipelines.

■ Loaded Data warehouse tables using bulk copy into command.

■ Leverage industry-leading integration analytics tools to build a modern data warehouse that is accurate, high-performance, and accessible to our business department.

EDUCATION & CERTIFICATE

■ Bachelor’s Degree (August 2018)

■ Preparing for DP-900: Microsoft Azure Data Fundamentals Exams ( Coursera)



Contact this candidate