Data Engineer Power Bi

VIDYA SAGAR GADDAMEEDI

Email: ****************@*****.*** Mobile: +1-551-***-****

Summary

Experienced Data Engineer with around 4 years of expertise in designing and optimizing scalable data solutions. Demonstrated success in building ETL pipelines and data models, driving business decisions with advanced analytics tools. Key achievement includes engineering ETL pipelines that process records daily, improving operational efficiency. Proficient in Python, SQL, AWS, Azure, Apache Spark, and cloud technologies. Capable in optimizing data processing and ensuring regulatory compliance. Technical Skills

• Programming Languages: Python, JavaScript, SQL

• Databases: MySQL, PostgreSQL, MongoDB

• Big Data Technologies: PySpark

• Web Technologies: React, HTML, CSS, Node.js

• Cloud Platforms: Azure, AWS

• Data Visualization Tools: Power BI, Tableau

• Operating Systems: Windows, Linux, Unix

• Development Tools: Anaconda, Visual Studio

• Version Control: Git, Bitbucket

Professional Experience

Client: Intuit San Francisco

Role: Data Engineer Sep 2023 – Present

Responsibilities:

• Built and managed ETL pipelines using Python and SQL to process daily data from Oracle, Hadoop, and Kafka, transferring it into Snowflake for reliable storage and efficient data access.

• Worked closely with data scientists and business teams to create data-driven solutions, using tools like Python and Snowflake to improve reporting and decision-making processes.

• Used AWS services like S3 for storage, Glue for ETL processing, and Redshift for analytics, as well as Azure tools like Data Factory and SQL Database to create cost-effective and scalable data pipelines and storage solutions.

• Built a data catalog system using AWS Glue Data Catalog and metadata management techniques to make organizational data easier to find and use.

• Improved the performance of data pipelines by reworking workflows with Apache Spark on AWS EMR and fine-tuning storage processes in Snowflake, significantly reducing processing times and costs.

• Integrated analytics tools like Tableau and Power BI with Snowflake and Redshift to enable advanced reporting and better visualization of business insights. Client: eBay Aug 2020 – Dec 2022

Role: Software Engineer – Development

Responsibilities:

• Developed and optimized SQL queries for data extraction, transformation, and reporting, ensuring accurate and efficient data handling for business processes.

• Gained hands-on experience with AWS services such as S3, Redshift, and Lambda for data storage, processing, and serverless application deployment.

• Automated routine tasks using Python, including data validation, ETL processes, and monitoring workflows, enhancing productivity and reducing manual effort.

• Assisted in the development of scalable backend systems, applying core software engineering principles to ensure high-quality and maintainable code.

• Participated in automating database maintenance and monitoring using Python scripts, ensuring the reliability of SQL and NoSQL database systems.

• Collaborated with software engineering teams to integrate data solutions into web and mobile applications, ensuring seamless functionality.

• Gained foundational knowledge in software development lifecycle processes, including version control (Git), code reviews, and Agile methodologies, to ensure efficient project delivery. Education

Master of Science in Data Science August 2023 – December2024 New England College, Henniker, NH, USA

Bachelor of Technology in Electrical and Communications Engineering June 2018 – June 2022 Institute of Aeronautical Engineering, Hyderabad, Telangana, India

Contact this candidate