Post Job Free
Sign in

Data Engineer Power Bi

Location:
Kissimmee, FL
Posted:
October 19, 2024

Contact this candidate

Resume:

MANOJ YANALA

Orlando, FL 513-***-**** ****************@*****.***

PROFESSIONAL SUMMARY

Highly skilled Data Engineer with 4+ years of experience designing, developing, and optimizing data pipelines and cloud-based applications. Expertise in cloud platforms like AWS, Azure, and GCP, alongside proficiency in Python, SQL, and Spark for building scalable solutions. Adept at automating ETL processes, improving operational efficiency, and delivering actionable insights through Power BI and Tableau. Proven track record of leveraging data technologies to drive business impact and efficiency. Strong ability to solve complex data problems and streamline workflows in dynamic environments.

SKILLS & OTHERS

Programming Languages: Python, Java, SQL, Scala

Cloud Platforms: AWS (S3, Glue, Redshift, Lambda, EMR), Azure (Data Factory, Databricks), GCP (BigQuery)

Big Data Technologies: Apache Spark, Kafka, Airflow, Hadoop

Databases: PostgreSQL, Snowflake, MongoDB, MSSQL

Data Visualization: Power BI, Tableau

DevOps Tools: Docker, Kubernetes, Jenkins, Terraform

Version Control & CI/CD: Git, GitHub, Bitbucket, Azure DevOps

Automation & Orchestration: Apache Airflow, Jenkins, Azure Pipelines

WORK EXPERIENCE

Client - HSBC Bank Orlando, USA

Data Engineer Jan 2023 – Present

oLed the migration and modernization of legacy ETL pipelines by translating existing SAS workflows into Python, improving overall processing efficiency by 40%.

oDeveloped advanced SQL queries to streamline data transformations, handling complex banking data operations, and ensuring seamless integration with Snowflake for enhanced data storage.

oAutomated the ingestion and transformation of over 500,000+ rows of financial data using PySpark and AWS Glue, significantly reducing manual data manipulation tasks.

oCollaborated with cross-functional teams, utilizing Airflow to orchestrate data workflows and schedule jobs, reducing cloud operational time by several hours per day.

oEnhanced banking data warehousing by integrating AWS S3, Lambda, and Snowflake, which led to a 30% improvement in query performance and data retrieval speeds.

oTested and validated data transformations using a structured test plan to ensure accuracy and functionality in the migration from legacy systems to Python and Snowflake environments.

Technologies Used: Python, SQL, Snowflake, AWS Glue, Airflow, PySpark, AWS (S3, Lambda)

Client - BMW (North America) Hyderabad, India

Azure Data Engineer Mar 2021 – Jun 2022

oDeveloped and optimized a loan approval system using Azure Data Factory and Azure SQL Database, improving data processing efficiency by 30% for over 10,000 users.

oCreated and maintained 5+ ETL pipelines using Azure Databricks and Python, automating data ingestion from various sources with 99% accuracy.

oLed the implementation of Azure DevOps for incident management and root cause analysis, resolving 90% of high-priority issues within 4 hours, ensuring system reliability.

oEngineered end-to-end data tracking using Azure Monitor and Databricks, resulting in a 20% improvement in operational efficiency and faster decision-making.

Technologies used: Azure Data Factory, Azure Databricks, Python, Azure SQL Database, Power BI, Azure DevOps, SQL

Client - Centene Corporations Hyderabad, India

ETL Developer Apr 2020 – Mar 2021

oDesigned and implemented automated ETL pipelines using PostgreSQL, Python, and Informatica to extract, transform, and load healthcare data, ensuring regulatory compliance and 100% data accuracy.

oReduced manual efforts by 30% by building automated workflows for data transformation, improving operational efficiency.

oOptimized SQL queries to improve data processing speed by 25%, facilitating faster data availability for downstream systems.

oCreated real-time dashboards with Tableau, improving data visualization for key decision-makers and enhancing insights into patient data.

Technologies used: Informatica, PostgreSQL, Python, Tableau, Advanced SQL

EDUCATION

University of Cincinnati, Cincinnati, USA Dec 2023

Master of Science, Information Technology

Osmania University, Hyderabad, India Jul 2021

Bachelor of Engineering, Information Technology

CERIFICATIONS

•Microsoft Certified Azure Administrator Associate

•Certified Kubernetes Administrator (CKA)

PROJECTS HIGHLIGHTS

Loan Processing System (BMW)

oDesigned and deployed a data pipeline to process 10,000+ loan applications daily, reducing processing time by 30% and ensuring data accuracy.

Real-Time Data Pipeline (HSBC)

oImplemented AWS services to automate data ingestion and real-time reporting, reducing cloud processing times by several hours and improving data availability.



Contact this candidate