Data Engineer

Bhavana Shanivendram

DATA ENGINEER

Location: Austin, TX Ph: +1-928-***-**** Mail: **********************@*****.***

PROFESSIONAL SUMMARY:

4+ years of experience as a Data Engineer with expertise in designing, developing, and deploying robust and scalable data pipelines. Proven experience in leveraging technologies such as Python, SQL, Spark, Kafka, Snowflake, AWS, Azure, Kubernetes, Docker, Airflow, NiFi, Jenkins, GitLab, TensorFlow, Scikit-learn, Power BI, Tableau, ELK Stack, Datadog, Flask, REST APIs, to extract, transform and load data from various sources into data warehouses and data lakes. Adept at building and optimizing data pipelines for high-volume, real-time data processing and analysis. Strong understanding of data warehousing, data modeling, data governance, and data quality best practices. Proven ability to collaborate effectively with cross-functional teams to deliver data-driven solutions that support business objectives.

TECHNICAL SKILLS:

•Data Engineering: Apache Spark, Apache NiFi, Apache Kafka, Airflow, Azure Data Factory, Snowflake, ETL Pipelines,

Data Transformation

•Programming Languages: Python, SQL

•Machine Learning: Scikit-Learn, TensorFlow

•Big Data: Spark Streaming, Hadoop Ecosystem

•Cloud Platforms: AWS (Lambda, Cloud Storage), Azure

•Data Visualization: Tableau, Power BI

•Data Warehousing: Snowflake, Oracle, MySQL, NoSQL Databases

•Data Governance: HIPAA Compliance, Data Encryption, Access Control, Data Quality Checks

•Monitoring & Logging: ELK Stack (Elasticsearch, Logstash, Kibana), Datadog, Grafana

•API Development: RESTful APIs, Flask

•DevOps: Jenkins, GitLab, CI/CD Pipelines, Docker, Kubernetes

•Regulatory Standards: HL7, FHIR

•Database Optimization: Partitioning, Clustering, Indexing Strategies, Performance Tuning

•Workflow Management: Agile, Scrum, JIRA

•Statistical Tools: Advanced SQL Queries, Data Analytics

•Version Control: Git, GitHub

•Operating Systems: Windows, Linux, Mac iOS

CERTIFICATIONS:

•AWS Certified Data Engineer

•Microsoft Certified Azure Data Engineer

PROFESSIONAL EXPERIENCE:

Data Engineer Cigna Healthcare - TX June 2024 – Present

•Deployed a robust data pipeline that processes and transforms daily patient records, achieving a 30% reduction in data latency and enhancing real-time analytics capabilities for clinical decision-making.

•Spearheaded the integration of HL7 and FHIR standards across multiple healthcare systems, ensuring a seamless and compliant data exchange process that achieved a 95% adherence rate to industry standards, improving interoperability.

•Developed and optimized interactive dashboards in Tableau that provided actionable insights, resulting in a 20% increase in patient appointment scheduling efficiency and improved operational workflows.

•Automated complex ETL processes utilizing Azure Data Factory, leading to a 40% decrease in manual data handling and significantly reduced data processing errors, thereby enhancing data reliability.

•Leveraged Apache Spark for efficient large-scale data processing, optimizing performance metrics and resource utilization, which facilitated the handling of vast datasets typical in healthcare analytics.

•Conducted in-depth performance tuning of SQL queries, enhancing database efficiency and reducing query response times, which improved the overall performance of data retrieval operations.

•Developed and deployed machine learning models using Scikit-Learn to accurately predict patient readmission rates, enabling healthcare providers to refine care strategies and reduce readmission occurrences.

•Implemented comprehensive monitoring solutions using ELK Stack and Datadog to oversee system performance and data integrity, proactively identifying and resolving issues to maintain operational continuity.

•Ensured stringent compliance with HIPAA regulations by implementing advanced data encryption techniques and robust access control measures, safeguarding sensitive patient information throughout its lifecycle.

•Conducted specialized workshops on data governance and compliance for internal teams, fostering a culture of data stewardship and ensuring adherence to regulatory requirements across the organization.

Data Engineer Smart AI – India Sep 2020 – Dec 2022

•Designed and implemented high-throughput ETL pipelines using Apache NiFi and Airflow, ingesting data from diverse sources (Oracle, MySQL, NoSQL databases, cloud storage) into Snowflake data warehouse.

•Orchestrated real-time data processing workflows using Kafka, Spark Streaming & AWS Lambda, achieving sub-second latency for critical business applications. Managed Docker containers & Kubernetes clusters, ensuring scalable and resilient data processing infrastructure.

•Maintained optimized Snowflake data warehouse schemas, including partitioning, clustering, and indexing strategies, resulting in significant performance improvements.

•Created automated CI/CD pipelines using Jenkins and GitLab, enabling continuous integration & deployment of data pipelines with a 99% success rate. Deployed ML pipelines using TensorFlow and Scikit-learn, enabling predictive analytics and data-driven decision-making.

•Developed and deployed RESTful APIs using Python Flask, providing secure and efficient data access to internal and external applications.

•Implemented robust data quality checks and monitoring mechanisms using ELK Stack and Grafana dashboards, identifying and resolving data anomalies with a 95% accuracy rate.

•Created data transformation logic using Spark SQL, handling complex business rules, and achieving high data processing throughput.

•Developed interactive Power BI dashboards for real-time business metrics visualization, providing key insights to stakeholders and supporting data-driven decision-making.

EDUCATION

Master of Computer Science - Northern Arizona University, Flagstaff, AZ, USA.

Bachelor of Computer Science – Malla Reddy Institute of Engineering and Technology, Hyderabad, India.

Contact this candidate