Data Engineer Senior Aws

R HARISH

+1-603-***-**** ️ *****************@*****.*** LinkedIn: linkedin.com/in/harish-ravella

Senior AWS Developer Data Engineer Kafka Redshift Lambda Glue Flink

PROFESSIONAL SUMMARY

AWS Certified Senior Developer with 5 years of experience designing, developing, and optimizing scalable data solutions in cloud environments. Proven track record working with streaming technologies like Kafka and Apache Flink, serverless architectures using AWS Lambda, and building robust data pipelines in Redshift and Glue. Experienced in CI/CD using Terraform and Python-based data engineering across Manufacturing, Banking, and Healthcare domains. Strong collaborator with cross-functional teams, committed to data integrity, security, and business-driven analytics.

CORE COMPETENCIES

Cloud Platforms: AWS (Redshift, Lambda, Glue, S3, EMR, CloudWatch)

Streaming & Messaging: Kafka, Apache Flink

ETL & Data Processing: AWS Glue (PySpark/Python), Informatica

IaC & DevOps: Terraform, CI/CD Pipelines, Git, Jenkins

Programming Languages: Python, PySpark, SQL

Databases & Storage: Redshift, PostgreSQL, DynamoDB, S3

Security & Monitoring: IAM, KMS, CloudTrail, CloudWatch

Others: Agile/Scrum, Data Lake, Smart Grid (Domain Experience)

PROFESSIONAL EXPERIENCE

Senior AWS Developer CVS Health Dallas, TX

Duration: Apr 2023 – Present

Project: Cloud-native healthcare data ingestion and analytics

Developed scalable data ingestion pipelines using Kafka, AWS Lambda, and Redshift to support near real-time claim and patient data analytics.

Implemented AWS Glue PySpark jobs to transform and load pharmacy and provider data into Redshift.

Built a CI/CD pipeline using Terraform for infrastructure provisioning, ensuring compliance and repeatability.

Enabled event-driven architectures with Lambda functions and step functions to orchestrate data workflows.

Led data validation and profiling strategies, ensuring HIPAA-compliant data integrity across ingestion zones.

Collaborated with stakeholders to design patient engagement analytics using insights from Redshift clusters.

Conducted code reviews and mentored junior developers on AWS Glue optimization and security best practices.

Environment: AWS Glue, Kafka, PySpark, Lambda, Redshift, Terraform, S3, GitHub, Jenkins

AWS Data Engineer Wells Fargo Dallas, TX

Duration: Dec 2021 – Mar 2023

Project: Risk and Fraud Data Platform Modernization

Designed and deployed real-time fraud detection pipelines using Kafka, AWS Lambda, and Apache Flink.

Migrated legacy data processing from on-prem to Redshift, achieving 30% performance improvement.

Built reusable Terraform modules for setting up VPCs, Lambda triggers, Redshift clusters, and S3 policies.

Integrated Informatica Cloud for batch-based ETL processes and supported cross-platform orchestration.

Created modular Glue jobs and parameterized PySpark scripts for regulatory reporting and data lineage.

Tuned Redshift queries and used Spectrum to optimize storage cost and boost reporting speed.

Environment: Kafka, Redshift, AWS Lambda, Glue (PySpark), Apache Flink, Informatica, Terraform

Big Data Engineer Cohesity India

Duration: Jun 2020 – Aug 2021

Project: Smart Manufacturing & Logistics Analytics Platform

Architected and implemented data lake solutions using AWS S3, Redshift, and Glue for IoT sensor ingestion.

Streamed equipment telemetry using Kafka, and processed it with AWS Lambda + Flink for real-time monitoring.

Automated deployment of resources using Terraform, ensuring scalable infrastructure provisioning.

Worked closely with supply chain teams to design anomaly detection logic in PySpark and integrated insights into dashboards.

Maintained data quality frameworks and lineage using AWS Glue Catalog, Glue Job Bookmarks, and Redshift Spectrum.

Played a pivotal role in ensuring data security with IAM, KMS, and S3 encryption.

Environment: Kafka, AWS Glue, Lambda, Flink, Redshift, S3, Terraform, CloudWatch, Python

CERTIFICATIONS

AWS Certified Developer – Associate

AWS Certified Data Analytics – Specialty (in progress)

EDUCATION

Master of Computer’s in Information Systems

New England college / Henniker/ NH

Contact this candidate