Big Data Engineer

Pavan Kumar Vadlapudi Resume Page ** 248-***-**** **************@*****.*** LinkedIn

PAVAN KUMAR VADLAPUDI

248-***-**** **************@*****.*** San Diego, CA 92126 LinkedIn Data Engineer High-Performance Pipeline Management Cloud Infrastructure Design Data Integrity Enhancement

Stakeholder Management

Passionate data engineer with experience facilitating business decisions by building, expanding, and modifying data pipelines. Adept at developing and integrating cloud-based data platforms within the existing infrastructure. Expert at driving productivity by deploying big data management and automation. Tightens system security by auditing the technical framework and preventing non-compliant behaviors. Translates business requirements into development tasks and forges professional relationships. Business Requirements Gathering

Database Creation & Improvement

Disparate Data Collection & Management

Solution Formulation & Deployment

Report & Insight Generation

Data Migration Oversight

Technical Project Management

Multi-Disciplinary Stakeholder

Management

Process Design, Monitoring, &

Improvement

TECHNICAL SKILLS

AWS, k T-SQL (MS SQL Server), PL/SQL (Oracle), MySQL, SSIS, SSRS, Python, GCP, AWS, Tableau, Apache Hadoop, Apache Hive, Apache Spark, PySpark, IBM DataStage, JSON, JavaScript, Microsoft Office PROFESSIONAL EXPERIENCE

Data Engineer

Betasharp Inc, State Street Project 04/2023 - Present MB IT Associates LLC, State Street Project 10/2018 – 03/2023 Addressed high-impact problems by providing end-to-end database management services, including creation, maintenance, and security; collaborated with cross-functional teams. Established expertise in cloud technologies and led big data migrations from legacy to AWS using Airflow, DataBricks, and PySpark; created data pipelines and conducted data importing and exporting utilizing CSV files. Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark data bricks cluster. Risk Assessment & Mitigation Planning Process Simplification

• Enabled data-driven executive decision making, influencing multi-million-dollar financial impacts, by working on Enterprise Governance, Risk and Compliance (EGRC), conducting risk assessments, and creating financial impact reports; liaised with business SMEs and utilized Tableau dashboards.

• Collaborated with cross-functional teams to develop and implement mitigation plans, prioritizing critical issues to enhance security.

• Regularly reviewed AWS service configurations, IAM policies, and VPC settings to maintain a secure environment.

• Facilitated the security of financial transactions by researching and assessing the impact of cryptography on threat mitigation. Pavan Kumar Vadlapudi Resume Page 02 248-***-**** **************@*****.*** LinkedIn Data Migration & Transformation Improvement Opportunity Identification

• Collaborated with stakeholders to define data quality metrics and implemented AWS Data Quality tools, improving data quality by 25%.

• Enhanced data movement and transformation by using AWS EMR and creating EMR clusters; readjusted cluster configuration leveraging efficient algorithms and data structures; utilized Apache Hadoop, Apache Hive, and Apache Spark.

• Identified bottlenecks in data pipelines and implemented AWS Glue for ETL processes, achieving a 40 – 50% increase in data processing speed.

• Developed custom Python scripts and AWS Glue jobs to perform data transformations, ensuring data consistency and adherence to business rules.

Data Consistency & Reliability Standard Process Development

• Developed and implemented standardized data consistency and reliability processes for AWS environments, resulting in a 25% reduction in data errors and 20% improvement in data availability.

• Conducted regular data audits and implemented AWS Data Quality tools to ensure data integrity and accuracy, leading to a 40% reduction in data anomalies.

• Implemented AWS Backup and Disaster Recovery solutions, ensuring data resilience and reducing recovery time by 30%.

• Collaborated with stakeholders to define process metrics and key performance indicators (KPIs), achieving a 20 – 30% improvement in process monitoring and control.

EDUCATION

Master of Science in Information Systems Security, University of the Cumberland’s 2019 Scored a 3.9/4.0 GPA and studied various subjects, including Telecommunications Network Security, Security Architecture and Design, Operations Security, Physical security, Application security, Legal Regulations, Compliance & Investigation, Access Control, Business Continuity Plan & Disaster Recovery Plan, Information Security & Risk Management, and Cryptography.

• System Security Enhancement: Defined an infrastructure for security module design and threat mitigation using STRIDE for threat modeling; developed solutions by anticipating viewpoints of attackers, assets, and systems.

• Investigative Research: Studied hacking and regulatory cases and assessed the legal steps taken by high-profile organizations. Bachelor of Science in Mechanical Engineering, Jawaharlal Nehru Technological University 2014

• Technological Innovation: Designed a fully functional electronic car in 2014 by collaborating with a team of 4; achieved a 3/4 GPA.

Contact this candidate