Senior Data Engineer - ETL, Oracle Exadata, Linux Automation

Divya Sri Mullapudi - Senior Data Engineer

*************@*****.*** +1-806-***-****

PROFESSIONAL SUMMARY

Senior Data Warehouse Engineer with over 5 years of experience designing, implementing, and optimizing robust data warehousing solutions and ETL processes. Possesses a strong foundation in Linux environment setup, shell scripting for process automation, and Oracle development, including practical experience with Oracle Exadata. Proven expertise in enhancing ETL/database load/extract processes, implementing system/architecture improvements, and managing complex Linux-based infrastructure. Adept at utilizing Python and Perl for scripting and data manipulation, with hands-on experience in Informatica and Airflow for orchestration. Passionate about automation and continuous process improvement, applying Agile methodologies to deliver high-performing, scalable data ecosystems.

SKILLS

Programming & Scripting: Python, Shell Scripting, SQL, Perl, PySpark, Scala Databases & Data Warehousing: Oracle Exadata, PostgreSQL, MySQL, MongoDB, Snowflake, Teradata, Hive

ETL & Orchestration: Informatica PowerCenter, Apache Airflow, Apache Spark, Hadoop, Databricks, AWS Glue, Azure Data Factory, GCP Dataflow

Cloud Platforms: AWS (S3, Redshift, EMR, Athena), Azure (Synapse), GCP (BigQuery) Operating Systems & DevOps: Linux, Git, Jenkins, Docker, Kubernetes BI & Visualization: Power BI, Tableau, Looker

Methodologies: Agile/Scrum, Data Modeling, Data Governance, Performance Optimization EXPERIENCE

Senior Data Engineer @ Bread Financial, Columbus, Ohio Oct 2023 – Present

Implemented and managed critical Linux-based processes and infrastructure supporting large-scale data warehousing initiatives.

Designed and optimized robust ETL/database load processes for high-volume customer transactions using Informatica and Oracle Exadata.

Developed advanced shell scripts for automating data extraction, transformation, and loading workflows across various source systems.

Identified and implemented significant system architecture improvements, enhancing the performance and scalability of data warehouse operations.

Enhanced various Linux-based toolsets, scripts, and scheduled jobs to streamline data pipeline orchestration and monitoring.

Orchestrated complex data pipelines with Apache Airflow using Python, ensuring timely delivery and high data quality for financial analytics.

Administered and tuned Oracle Exadata databases, optimizing query performance and managing data partitioning strategies.

Collaborated with cross-functional teams to integrate diverse data sources into the data warehouse, supporting real-time fraud detection.

Ensured compliance with data governance standards and security protocols for sensitive financial data within the Linux environment.

Developed comprehensive documentation for data warehouse architecture, ETL processes, and Linux system configurations.

Environment: Linux, Shell Scripting, Oracle Exadata, Informatica PowerCenter, Apache Airflow, Python, SQL, AWS Redshift, Snowflake, Apache Spark, Git Data Engineer @ Amae Health, Los Angeles, California Feb 2021 – May 2023

Managed Linux servers and developed shell scripts for automated data processing and system monitoring within the healthcare data warehouse.

Enhanced ETL/database load/extract processes for patient records and clinical outcomes using Informatica PowerCenter.

Optimized Oracle database performance and managed schema designs for large-scale healthcare data warehousing initiatives.

Implemented system architecture improvements to enhance the reliability and efficiency of data ingestion pipelines.

Developed Python scripts for complex data transformations and integration, ensuring data quality and consistency.

Utilized Apache Airflow with Python to orchestrate and automate daily ETL jobs, improving overall data pipeline reliability.

Ensured HIPAA compliance through secure data handling practices and robust access controls within the Linux environment.

Collaborated with data scientists to prepare and provision curated datasets for predictive mental health outcome models.

Conducted thorough data validation and reconciliation activities to maintain accuracy across various data sources.

Contributed to continuous process improvement initiatives, streamlining data flow from source systems to analytical platforms.

Environment: Linux, Shell Scripting, Oracle, Informatica PowerCenter, Apache Airflow, Python, SQL, AWS Redshift, Snowflake, Apache Spark, Tableau

Data Engineer @ Costco Wholesale, Issaquah, Washington Nov 2019 – Jan 2021

Developed and maintained robust ETL pipelines for retail transaction and inventory data using Azure Data Factory and Python.

Designed and implemented data models within Azure Synapse Analytics for sales forecasting and promotions analysis.

Optimized SQL queries and PySpark jobs, significantly reducing batch processing time for millions of daily retail transactions.

Integrated diverse point-of-sale and e-commerce data into a centralized Azure Synapse data warehouse.

Automated data ingestion processes from various vendor APIs and flat files, improving data freshness and availability.

Built comprehensive Power BI dashboards to monitor product performance, seasonal demand, and regional sales trends.

Ensured strict compliance with PCI-DSS standards for the secure handling and storage of customer payment data.

Collaborated with merchandising teams to deliver actionable insights on customer buying patterns and supply chain efficiency.

Conducted rigorous data reconciliation and validation activities between raw and curated data layers to maintain accuracy.

Streamlined data delivery processes, enabling business analysts to access curated datasets for self- service reporting efficiently.

Environment: Azure Data Factory, Azure Synapse, Python, SQL, PySpark, Databricks, Power BI, Git EDUCATION

Master of Science in Computer Science @ Texas Tech University

Contact this candidate