Data Migration Cloud Engineer

Venkata Gopinath Lagadapati

Sr. Cloud Engineer

********.******@*****.*** +1-929-***-**** linkedin.com/in/gopinath-lagadapati/

PROFILE SUMMARY

Experienced Multi-Cloud Architect and Site Reliability Engineer with 7+ years of expertise in designing scalable solutions across Azure, AWS, and GCP. Proficient in DevOps, Python, Data Engineering, and CI/CD pipelines, with strong skills in cloud migration, infrastructure automation, and database optimization. Skilled in monitoring and performance management using Splunk, Datadog, Prometheus, and Grafana, with a strong background in data warehousing, ETL processes, and Agile methodologies. Certified in cloud and DevOps technologies, with a proven track record of leading teams to deliver high-quality, reliable cloud applications.

PROFESSIONAL EXPERIENCE

Senior Cloud SRE Engineer 01/2024 – Present LTIMindtree (Microsoft)

Implemented Azure Storage Mover for large-scale data migration, transferring petabytes of data between Azure and on-premises storage.

Improved system uptime by 20% through the implementation of intelligent alerting systems and performance tuning of storage infrastructure.

Reduced incident response times by 30% by designing comprehensive monitoring solutions and automating storage management workflows.

Developed automation scripts and workflows to streamline data migration processes, leveraging Azure Storage Mover APIs and PowerShell for efficient data transfer and synchronization.

Provided production support for Azure-based internal projects, advocating for customer needs and ensuring smooth operation of storage and data migration workflows.

Configured intelligent alerting systems using Prometheus and Datadog to monitor data migration processes, improving system uptime and reducing incident response times.

Conducted performance tuning and optimization of storage infrastructure and applications, analyzing metrics in Prometheus, Grafana, and Datadog to ensure optimal performance during large-scale data transfers.

Designed and implemented comprehensive monitoring solutions for storage and data migration workflows using Prometheus and Grafana, ensuring system reliability and high availability.

Wrote Terraform code to provision and manage Azure storage resources, creating reusable modules for consistent and scalable deployments of storage infrastructure.

Provisioned Azure resources such as VMs, storage accounts, and networking components, maintaining a 24x7 cloud infrastructure for critical services with 99.999% uptime.

Led Azure DevOps CI/CD pipeline development for storage and data migration workflows, integrating automated testing and validation to ensure data accuracy and integrity.

Managed Azure Storage Accounts (Blob, File, Queue, Table), improving data security and accessibility through Active Directory integration and role-based access control (RBAC).

Designed and deployed Azure Databricks and Elastic SAN solutions to support efficient data processing and storage performance for enterprise applications.

Technology Consultent 09/2021 – 08/2022

Tredence Analytics

Led the architecture transformation of SDF applications for high availability and disaster recovery, migrating to a multi-region database structure.

Developed and automated CI/CD processes using AWS CodePipeline, Terraform, and cloud-based network functions (CNF).

Developed data pipelines using GCP services like Dataflow, Dataproc, and Pub/Sub, implementing event-driven architectures and managing data workflows between GCP and external sources.

Managed data storage solutions on GCP, including BigQuery, Cloud Storage, and Cloud SQL, and facilitated data transfer from Azure Blob to GCP Buckets using GCP Storage Transfer Service.

Managed technical teams and implemented change management for production data refreshes.

Migrated company workload to AWS, utilizing EC2 and S3 for scaling, improving efficiency by 40%.

Ensured data integrity and reliability across the entire data lifecycle, from ingestion to storage to analytics.

Deployed and managed OpenStack hypervisors and VMs in DevOps, testing, and production environments.

Developed ETL workflows with AWS Glue for seamless data ingestion, transformation, and loading into the data lake.

Designed and implemented AWS Step Functions to orchestrate multi-step workflows for application deployment and data refresh. Integrated Step Functions with other AWS services like Lambda, SageMaker, S3, and EC2.

Led the migration to GCP, utilizing BigQuery, Cloud Dataflow, Cloud Pub/Sub, and Data Fusion to improve system performance, reduce discrepancies, and streamline data processes.

Senior Software Engineer 06/2020 – 09/2021

CAPGEMINI Engineering (Altran)

Evaluated and implemented Spectrum Virtualize for public cloud (SVPC), including host migration, kernel module installation, and Python code conversion, optimizing network management with shell scripts.

Designed and implemented Python-based automation scripts for deploying and managing Spectrum Virtualize for Public Cloud (SVPC) in multi-cloud environments (AWS and Azure), ensuring seamless integration with cloud-native services.

Developed a Python API for automated EBS disk discovery and attachment, streamlining storage provisioning and management for SVPC applications in cloud environments.

Created AMI creation workflows using Python and Docker, enabling the deployment of SVPC applications in both AWS and Azure Marketplaces with minimal manual intervention.

Optimized network management for SVPC by developing Python scripts and shell scripts, reducing deployment times by 30% and improving system reliability.

Implemented Python-based automation for kernel module installations and configurations, ensuring compatibility and performance optimization for SVPC in cloud environments.

Deployed and configured Spectrum Virtualize in cloud environments in 3 node and 5 node clusters, focusing on scalability, security, and performance, with storage pool setup and data replication.

Optimized data storage for integrity, availability, and performance, ensuring high system reliability in cloud-based solutions.

Experience in managing Linux servers, including CI server configurations, and handled application migration from CentOS 7 to CentOS 8.

Configured Azure Backup service for VM and on-premises data backup to Azure, using Azure Resource Manager (ARM) templates for server deployments.

Configured Azure VM availability sets and scale sets to ensure high availability and manage network traffic effectively in IaaS environments.

Installed and configured Jenkins for continuous builds, automating Docker image publishing to Nexus repository for streamlined DevOps processes.

Utilized Python Boto3 and Azure Python SDK for creating EBS volume pools, load balancing, and network interface configuration for Docker containers.

Developed and maintained custom kernel modules in Linux, optimizing system performance and stability for diverse environments. Configured and managed cgroups and container namespaces for efficient resource management and process isolation in containerized environments.

Designed and implemented high-performance iSCSI network SAN storage pools, optimizing storage solutions for containerized applications and virtualized infrastructure.

Cloud Engineer 10/2018 – 06/2020

MENTIS INC

Led product planning, team collaboration, database architecture, user privilege management, and issue resolution in AWS environments, ensuring smooth product delivery and testing.

Proficient in managing AWS services (RDS, EC2, Redshift, AWS Data Pipeline) and Azure services (SQL Server, Virtual Networks, App Services) with expertise in Python Spacy NLP library.

Designed and configured Azure Virtual Networks, Subnets, Network Security Groups, DNS Settings, and Security policies for efficient cloud infrastructure management.

Implemented disaster recovery strategies for Kubernetes environments, ensuring business continuity and minimizing downtime during outages.

Developed automation scripts for role-based access control (RBAC) in Azure, facilitating secure access to PROD and Non-PROD environments.

Monitored application performance and infrastructure health using New Relic and Splunk, proactively identifying and addressing security vulnerabilities and anomalies.

Skilled in automation using Terraform and orchestrating CI/CD pipelines with GitHub Actions.

Configured and managed Azure web apps, App Services, Application Insights, Application Gateway, Traffic Manager, and Network Watcher for high availability and performance.

Utilized monitoring tools like Prometheus and Grafana to track system performance, set up proactive alerts, and ensure high system uptime.

Administered and supported web-based applications, optimizing Linux systems for security, scalability, and performance across diverse environments.

Software Engineer 05/2016 – 10/2018

Sreeven infocom

Evaluated, deployed, and managed PHP applications on AWS Beanstalk, configuring monitoring and auto-scaling using CloudWatch alerts for optimal resource management.

Proficient in managing AWS services such as EC2, RDS, VPC, IAM, Route 53, DynamoDB, SES, SQS, and SNS for seamless cloud operations.

Designed and implemented scalable, highly available infrastructure in AWS using EC2, S3, RDS, Lambda, and CloudFormation, ensuring cost-effective and secure solutions.

Automated deployment pipelines using AWS CodePipeline, CodeBuild, and CodeDeploy, enhancing operational efficiency while adhering to security and cost optimization best practices.

Collaborated with cross-functional teams to establish DevOps practices, disaster recovery solutions, and automated infrastructure provisioning using Terraform and Ansible.

Optimized Amazon Redshift SQL queries, resulting in a 20% reduction in query execution time, significantly enhancing performance for large data workloads.

Utilized Spark, PySpark, and Scala to optimize algorithms on Hadoop, performing large-scale data transformations with Spark-SQL, DataFrame API, Spark Streaming, and MLlib.

Managed data ingestion and transformation using Sqoop, Flume, Hive, and MapReduce, ensuring smooth ETL processes to load data into HDFS for analytics.

Implemented Azure infrastructure and monitoring solutions, including Log Analytics, Network Watcher, and Service Health, to enhance service reliability and reduce performance issues.

Deployed and managed cloud infrastructure in GCP, utilizing services like GCP Compute Engine, BigQuery, Cloud Storage, Cloud Functions, and Google Dataflow for data processing, analytics, and application deployment.

SKILLS

Version Control and Source Code

Git, GitHub, SVN, Bit Bucket, AWS CodeCommit.

Build Automation and Deployment

Maven, Ant

Continuous Integration & Delivery

Jenkins, GitHub Actions, Gitlab CI/CD, GitOps, Azure DevOps, ArgoCD

Containerization and Orchestration

Docker, Kubernetes, Docker Swarm, AKS, GKE, EKS

Operating Systems

Windows, Linux, Unix, Red Hat, Ubuntu, CentOS.

Infrastructure as Code (IaC)

Terraform, AWS CloudFormation, ARM template, Ansible

Scripting and Automation

Groovy, Python, Java script, Shell script, Core Java.

Cloud Technologies

AWS, AZURE, GCP, Oracle, Snowflake

Database and Warehouse

MS SQL, MySQL, Oracle, PostgreSQL, MongoDB, Cosmos DB,BigQuery, Snowflake, RedShift, Databriks.

Observability

Splunk, Kibana, CloudWatch, Prometheus, Grafana, Dynatrace, Datadog, New Relic

Issue Tracking and Management

Jira, ServiceNow, DFM, Case Buddy

Bigdata

Hadoop, EMR, Dataproc, Scoop, Hive, HDFS, PySpark, YARN, HBase.

CERTIFICATATION

Microsoft Certified: Azure Data Engineer Associate

Microsoft Certified: Azure Administrator Associate

Microsoft Certified: Azure DevOps Engineer Expert

Oracle Cloud Infrastructure 2019 Architect Associate

ITIL Foundation Certificate in IT Service Management

AWS Certified Solution Architect – Associate

HashiCorp Certified: Terraform Associate

Certified Kubernetes Administrator - CKA

Google Cloud Professional Cloud Architect

AWARDS

WoW Team Excellence Award 10/2020

Altran (part of Capgemini)

The "WoW Team Excellence Award" is a recognition given for outstanding performance in teams at the organizational level. It highlights exceptional performance, collaboration, innovation, achievements, and positive impact.

MENTIS SUPERSTAR 03/2019

Mentis Inc

The "Mentis Superstar Award" for a Multi-Cloud Engineer is a prestigious recognition celebrating the exceptional expertise and achievements in managing cloud resources across multiple cloud providers. It signifies proficiency in innovation, cost optimization, security, and collaboration—all contributing to a positive impact on the organization. The award inspires me to excel in multi-cloud engineering and cloud architecture.

EDUCATION

Master of Science in Information Systems 12/2023 Maryville, Missouri

Northwest Missouri State University

Bachelor of Technology in Mechanical Engineering 04/2016 Vijayawada, India

JNTU Kakinada

Contact this candidate