Senior Data Engineer

Venkat Sai Jagini

913-***-**** # ****************@*****.*** ï Linkedin § My Github

Professional Summary

• Experienced Senior Azure Data Engineer with over 4 years in architecting, implementing, and optimizing data solutions on Microsoft Azure, specializing in data transformation, storage, and advanced analytics. Proven ability to deliver high-quality data pipelines and ETL processes that drive business insights.

• Proficient in Azure data services such as Azure Data Factory, Azure SQL Database, Databricks, Synapse Analytics, and Data Lake, with expertise in developing end-to-end data solutions that meet enterprise standards for reliability, performance, and security.

• Strong background in collaborating across cross-functional teams to translate business requirements into technical solutions, with a focus on data governance, performance tuning, and ensuring data accuracy and compliance in a cloud environment.

Technical Skills

Languages/Database: Java, Python, Scala, Pyspark, Sql Azure Cloud Servives: Azure Data Factory, Databricks, Synapse Analytics, Purview, Snowflake, Azure DevOps, Azure Data Lake Storage Gen 2 & Gen 1, Microsoft Fabric. Big Data Technologies : Hadoop, Flume, Oozie, Kafka, Apache Spark, Scala, Airflow. Experience

ABM Industries June 2023 – Present

Senior Azure Data Engineer Atlanta, Georgia

• Designed and implemented end-to-end data workflows using Azure Data Factory (ADF) across Azure Data Lake Storage

(ADLS) Gen2 layers in a Medallion architecture, ensuring efficient data processing, transformation, and governance.

• Configured Azure SQL Database for structured data storage and analytics, leveraging RBAC and Azure Key Vault to ensure secure access, credential management, and data compliance.

• Automated workflows using Azure Logic Apps and integrated Microsoft Purview for data lineage, governance, and policy adherence across systems.

• Implemented CI/CD pipelines with Azure DevOps to automate data workflows and ensure smooth deployment of ETL processes using PySpark and Python, enhancing data reliability and reducing manual intervention.

• Leveraged Microsoft Fabric, Azure Databricks, and Azure Synapse Analytics to build and optimize data solutions, and developed Power BI and Tableau dashboards to visualize complex datasets for actionable business insights. Tata Consultancy Services June 2020 – December 2022 Associate Data Engineer Hyderabad, Telangana, India

• Developed and optimized ETL processes using Informatica, Azure Data Factory, and SSIS to integrate data from diverse sources into Azure Data Lake, SQL Database, and data warehouses for analytics and reporting.

• Utilized SQL, Python, PySpark, and Scala for data cleaning, transformation, and migration across cloud platforms, ensuring high-quality data for analytics.

• Designed big data solutions with Apache Hadoop, Spark, and Azure Databricks for high-performance processing and real-time analytics on large-scale datasets.

• Implemented real-time streaming solutions with Azure Event Hubs and Kafka, enabling seamless handling of continuous data streams.

• Created and optimized T-SQL queries, stored procedures, and triggers to automate and enhance data processing, improving database performance and consistency.

Education

University Of Central Missouri, Warrensburg, MO January 2023 – May 2024 Master of Science in Computer Science GPA: 3.5/4.0 Vignan Institute of Technology, Hyderabad, India July 2017 – June 2021 Bachelors of Technology in Computer Science Engineering GPA: 3.4/4.0 Certifications

DP-203 Microsoft Certified Azure Data Engineer Associate

Contact this candidate