Post Job Free

Resume

Sign in

Devops Engineer Hadoop Data

Location:
Denver, CO
Posted:
July 02, 2022

Contact this candidate

Resume:

Akhil Kumar Patel

+1-240-***-****

adrluh@r.postjobfree.com

DevOps Engineer

PROFESSIONAL SUMMARY

Over 7 years of experience in the IT industry, with a focus on automation, Continuous Integration, Continuous Delivery, Build & Release Management, Configuration Management, Software Development Life Cycle (SDLC), and Cloud Infrastructure.

Designed DevOps workflow for multiple applications by orchestrating test, build, release, and deploy phases through various CI/CD pipelines.

Experience in dealing with Windows Azure IaaS - Virtual Networks, Virtual Machines, Cloud Services, Resource Groups, Express Route, VPN, Load Balancing, Application Gateways, Auto-Scaling, Traffic Manager.

Migrated On-premises virtual machine to Azure Resource Manager Subscription with Azure Site Recovery and deployed servers through ARM Templates.

Implemented cloud solutions using various AWS services including EC2, VPC, S3, Glacier, EFS, AWS Kinesis, IAM, Lambda, Directory Services, Security-Groups, CloudFront, Elk, RDS, SNS, SQS, SES, DynamoDB, ELB, Route-53, etc.

Worked on AWS Cloud Watch, Cloud Trail services, and CloudFront to set up and manage cached content delivery.

Defined several terraform modules such as compute, Network, Operations, and Users to reuse in different environments.

Worked with Chef Enterprise Hosted as well as On-Premises, Installed Workstation, Bootstrapped Nodes, Wrote Recipes and Cookbooks, and uploaded them to Chef-server, Managed On-site OS/Applications/Services/Packages.

Implemented, and managed monitoring and reporting of infrastructure using Splunk, Data Dog, New Relic, and Prometheus.

Experience in using Jenkins to drive all microservices builds out to the Docker registry and then deployed to Kubernetes using Helm.

Focused on containerization and immutable infrastructure. Worked on docker to build images, along with Docker Swarm and Kubernetes.

Integrated Kubernetes with network, storage, and security to provide comprehensive infrastructure and orchestrated containers across multiple hosts.

Experience in Deploying Splunk systems and monitoring Splunk internal logs from the monitoring Console (MC) to identify and troubleshoot existing or potential issues.

Developed Shell, Python, and PowerShell scripts for building, releasing, gathering inventory, and automating administrative tasks.

Managed Git repositories for branching, tagging, and merging. Integrated Git into Jenkins to automate the code checkout using git hooks.

Expertise in Azure Development worked on Azure web application, App services, VSTS, Azure storage, SQL Database, Virtual Machines, Azure AD, Azure search, and Notification hub.

Working with Terraform and Cloud Formation to automate AWS Cloud Infrastructure IAAS/PAAS Services.

Deployment of microservice on Kubernetes cluster using Helm Charts.

Experience with Linux/UNIX environments and Perl & Shell Scripting for Build & Release automation

Good at writing Playbooks for installing the packages like Apache, Tomcat, MySQL, and Nginx in Linux machines

Scripting in multiple languages on UNIX, LINUX, and Windows - Batch, Python, Shell script, etc.

Good in writing Ansible playbooks for continuous deployment and Configuration Management utilizing Ansible and Configuring, Automating, and Deploying ansible for configuration management to existing Infrastructure

Configuring, Automating, and Deploying ansible for configuration management to existing Infrastructure

Designed, built, and tested completely rebuilt infrastructure to move website from static hosting in Rackspace to containerized infrastructure-as-code maintained in AWS utilizing automation tools and frameworks like Ansible, Terraform, Nomad, Consul, Kubernetes.

TECHNICAL SKILLS

Azure

AWS

VMWARE

HYBRID CLOUD

MIGRATION

Python

BASH, POWERSHELL

LINUX, WINDOWS

JENKINS

AZURE DEVOPS

CODE PIPELINE

MAVEN, ANT

MS BUILD

DOCKER

KUBERNETES

MESOS

ELK STACK

NEW RELIC

TERRAFORM

AWS CLOUD FORMATION

ARM TEMPLATES

F5 LOAD BALANCER

LVM, RAID CONFIGURATION

ANSIBLE

CHEF

SALTSTACK

BITBUCKET

MongoDB, PostgreSQL, MySQL & SQL Server

JFrog

TOMCAT, IIS

NGINX

WEBLOGIC

Helm

BITBUCKET

GITLAB

NAGIOS

SPLUNK

WEBSPHERE

EXPERIENCE

Twitter, San Francisco, CA Jan 2021 - Current Sr. DevOps/Cloud Engineer

Designed, configured, and deployed Microsoft Azure for a multitude of applications utilizing the Azure stack (Including Compute, Web & Mobile, Blobs, ADF, Resource Groups, Azure SQL DW, DNS, Cloud Services, and ARM, focusing on high-availability, Disaster Recovery, fault tolerance, and auto-scaling).

Experience leveraging TFS (Team Foundation Server) environments using Visual Studio, .NET, and Microsoft SQL Server.

Used Microsoft Azure for Development, Test, and UAT environments for all customers regardless of the final Production platform (SaaS Cloud, Private secure cloud) to speed up the development/ deployment process and work within CI/CD framework (Team City, Octopus Deploy).

Implemented pipelines including Azure DevOps including Logging & Monitoring of the systems using required DevOps toolchains. Used Graylag for log monitoring paired with Grafana for data visualization.

Hands-on experience in using Terraform along with packer to create custom machine images and automation tools.

Manage Kubernetes helm charts and Kubernetes manifest files using Helm.

Integration of Maven, Azure DevOps, Urban Code Deploy with Patterns/Release, Git, Confluence, Jira.

Implemented a Continuous Delivery framework using Azure DevOps, Maven & Nexus in a Linux environment.

Automated the installation of ELK agent (FileBeat), Tomcat Web Server, JBOSS, WebLogic, and WebSphere Application Servers for deployment with ansible playbooks.

Wrote Ansible playbooks to launch Azure VM’s instances and used Ansible to manage web applications and configuration files using mount points and packages.

Worked on integrating GIT into the continuous Integration (CI) environment along with Anthill-Pro, Cruise Control, and Subversion. Written scripts to containerize using Dockers and orchestrate it using Kubernetes.

Good experience in securing application secrets using Azure key vault, configuring monitoring and logging using Log Analytics Workspace, Azure Monitor, Storage Accounts, etc.

Developed Azure PaaS services including web jobs, Azure SQL, Postgres, Azure SQL, Azure Data Factory (ADF), and Azure Service Fabric

Maintained technical documentation for launching and executing jobs on Hadoop clusters.

Experience in ingesting incremental updates from structured ERP systems residing on Microsoft SQL server database on to Hadoop data platform using SQOOP.

Worked on migrating Services from On-premises to Azure Cloud Environments, in collaboration with development and QA teams to maintain high-quality deployment

Established connection from Azure to On-premises datacenter using Azure ExpressRoute for Single and Multi-subscription connectivity.

Used Kubernetes in our project to orchestrate deployment, scaling, clustering, and management of containerized applications, Docker swarm for management of Docker containers of new and existing applications as well as deployment and management of the complex run-time environment

Automated installation of JDK 8, Tomcat, and several other software packages on multiple machines through SSH using Ansible Playbooks and maintained up to date

Extensively worked on Jenkins to achieve End to End Automation by Continuous Integration and Continuous Deployment for all the Builds and Deployments.

Worked on various Azure services like Compute (Web Roles, Worker Roles), Azure Websites, Caching, SQL Azure NoSQL, Storage, Network services, Azure Active Directory, API Management, Scheduling, Auto Scaling, and PowerShell Automation.

Tjx, Framingham, Massachusetts

June 2019 – Dec 2020

Sr. DevOps/ Cloud Engineer

Designed and migrated applications to AWS infrastructure utilizing services such as S3, EC2, ELB, EBS, RDS, ECR, EKS, VPC, auto-scaling, Kinesis, Route 53, Direct Connect, IAM, CloudFormation, Ops Works, Elastic Beanstalk, AWS S3, Amazon Glacier, EMR, RedShift, and Cloud Watch and Cloud Trail.

Worked on Docker container snapshots, removing images and managing Docker volumes and Docker container services using Docker Swarm.

Worked on using attributes, Chef templates, Chef recipes, and Chef files for managing the configurations across various nodes using RUBY.

Automated the cloud deployments using chef, python (boto & fabric), and AWS CloudFormation Templates.

Worked with Helm charts to template Kubernetes resources for deployment.

Developed microservice on boarding tools leveraging Python and Jenkins allowing easy creation and maintenance of build jobs and Kubernetes deploy & services

Create AMIs by using Packer for production usage as part of a continuous delivery pipeline.

Created and maintained continuous integration (CI) using tools Jenkins/Maven over different environments to facilitate an agile development process.

Managed build farm environment, workflow, and administration using Jenkins, GIT, Artifactory, Stash, Nexus, Jira, and various target build environments like Windows, and Linux.

Worked on utilizing CloudWatch and CloudTrail to monitor AWS resources such as EC2, Amazon RDS DB services, and Dynamo DB tables, to set alarms for notifications or automated actions, and to monitor logs for a better understanding and operation of the system.

Migrated on Premise MySQL database to Multi-Availability Zone RDS instances.

Worked on AWS Lambda to run the code in response to events, such as changes to data in an Amazon S3 bucket, Amazon DynamoDB table, HTTP requests using AWS API Gateway, and invoked the code using API calls made using AWS SDKs.

Automated the build, test, and deployment process of web applications python/java, by using AWS Code Commit, Code Build, Code Deploy, and Code Pipeline.

Integrated AWS Code Pipeline with ECS for container-based web application deployments.

Created IAM policies for delegated administration within AWS and Configure IAM Users/Roles/Policies to grant fine-grained access to AWS resources to users.

Configured various Downstream and Upstream jobs in Jenkins to build various pipeline jobs and integrated with various testing frameworks like Sonar, Selenium, Junit, Mockito, etc.

Implemented monitoring functionality of docker containers using Prometheus and Grafana.

Designed, configured, and implemented Nagios to monitor run scripts remotely via Nagios Remote Plugin Executor. And Used SonarQube and Veracode to generate unit-test coverage reports

Worked on Configuration Management Tool Chef & created Chef Cookbooks using recipes to automate system operations. Server automation with Chef and used tools like Maven for deployment and build management.

Knowledge of Splunk Architecture and deployment of Splunk clusters and Created Splunk dashboards for various business use cases.

Integrated Kubernetes with network, storage, and security to provide comprehensive infrastructure and orchestrated containers across multiple hosts.

Installation and configured the Datadog Agents onto EC2’s and On-Prem Linux and

Window servers.

Integrate the AWS accounts with Datadog for the collection of metrics and logs.

Onboard new data sources using Splunk best practices using inputs, props, and transform stanzas for data ingestion.

Client: Comcast, Dulles, Virginia June 2018 – June 2019

Site Reliability Engineer

Administer, develop & implement solutions for all DevOps Tools which include Jenkins, Bitbucket, Jira, and Nexus.

Responsible for the automation of web & batch deployments for 30 applications using Jenkins, Jira, Bitbucket & Nexus.

Daily operations including monitoring Jenkins, Jira, Bitbucket, and Nexus Logs for any errors, troubleshooting Deployment issues, help application teams with any issues regarding DevOps tools.

Setup Jenkins build jobs (maven, NodeJS), deployment scripts, and email notifications, and integrate with Jira/Bitbucket/Nexus for builds & deployment.

Create & edit Jira Issue types, Issue type schemes/screen schemes, Workflows, Workflow Schemes, Permission Schemes, Screens, and Custom fields.

Involved in designing and deploying a multitude of applications utilizing almost all the AWS stack including EC2, Route53, S3, RDS, Dynamo DB, SNS, SQS, LAMBDA, REDSHIFT

Create and maintain highly scalable and fault-tolerant multi-tier AWS environments spanning across multiple availability zones using Terraform.

Write terraform scripts from scratch for building Dev, Staging, Prod, and DR environments.

Production support for all the application releases during deployments.

SME for DevOps Toolset, prepared Architecture blueprints, and requirements documentation including base infrastructure details like system configuration, software versions, firewalls, sudo rules, and service accounts.

Responsible for complete design & implementation of DevOps for Data center migration project.

Meet with the respective Design leads, and stakeholders to analyze, and design the requirements for new projects.

Expertise in Creating, Debugging, Scheduling, and Monitoring jobs using Airflow.

Configure access.conf files, setup ssh connections to JBOSS servers for deployments.

Setup new repositories in Bitbucket, provide permissions and assist application teams with setting up, Branching, Tagging, and integrating with Jenkins.

Manage & Assign roles in Jenkins using Role-Based Strategy, download & integrate plugins.

Installing necessary upgrades & maintain currency for all the DevOps Tools.

Integrated Jenkins, Jira & Bitbucket with LDAP for user authentication, imported LDAP cert for SSL protocol.

Worked with various scripting languages like Bash, Shell, and groovy.

Work with QA teams for automation of QA tasks through the DevOps deployment process.

Perform POCs for any new application, plugins, workflow changes, or currency upgrades in the test environment.

Generate Monthly reports for the senior managers regarding application deployments from Jira & Jenkins.

Manage & update groovy scripts used for automating deployments through Jira to Jenkins

Randolph Brooks FCU – Live oak, TX Jan 2017 – June 2018

Cloud/DevOps Engineer

Worked on designing and deploying a multitude of applications using most of the AWS stack like EC2, Route53, S3 buckets, RDS, Dynamo DB, SNS, SQS, IAM, VPC, EBS, and focusing on high-availability, fault tolerance, and auto-scaling

Created S3 buckets and managed policies and utilized S3 bucket and Glacier for object storage and archiving, Automated the creation of EBS snapshots and stored them in S3 buckets after encryption

Implemented Security groups for inbound and outbound access, network ACLs for controlling traffic through subnets, Internet Gateways, NAT instances, and Route Tables to direct network traffic and ensure secure zones for organizations in the AWS cloud

Setup Elastic Load Balancer for distributing traffic among multiple Web Logic servers and Involved in deploying the content cloud platform on Amazon Web Services using EC2, S3, and EBS.

Wrote Python Scripts to Automate AWS services which include web servers, ELB, CloudFront Distribution, database, EC2 and database security groups, S3 bucket, and application configuration, and deployed and configured Elastic search (ELK) for log analytics, full-text search, application monitoring in integration with AWS Lambda

Implemented LAMP stack image in multitier AWS instances in different subnets in Amazon VPC, attached ACLs and Security Groups to maintain high security.

Modelled and automated the End to End Continuous Integration, Deployment, and Delivery pipeline which included building a Continuous Integration server utilizing tools like Jenkins, Nexus, maven, Git, and SonarQube.

Created Ansible Playbooks in Ansible Tower and integrated Ansible tower with Jenkins to deploy code to different servers also wrote Ansible Playbooks for installing JBoss, WebLogic, Nginx, and WebSphere for configuring load balancers and failover

Integrated Terraform with Ansible, and Packer to create and Version the AWS Infrastructure, code deployment, and orchestration with tools such as Chef, Cloud Formation, and automation validation using Test Kitchen, Ansible and Terraform.

Wrote Terraform template to create Load balancers, and EC2 instances with auto-scaling and monitoring on the fly for different environments. Creating an AWS RDS MySQL DB cluster and connected to the database through an Amazon RDS MySQL DB Instance using the Amazon RDS Console.

Developed Splunk Dashboards, searches, and reporting to support various internal clients in Security, IT Operations, and Application Development. Build performance dashboards through Splunk, and Extra hop wrote Java scripts and customized scripts and worked with internal clients to develop requirements, relationships, and value metrics

Responsible for setting up WebLogic clusters, and JDBC Data sources and involved in monitoring error logs, troubleshooting, and fixing the problems. Implemented Docker -maven-plugin in and maven pom to build Docker images for all microservices and later used Docker file to build the Docker images from the java jar files.

Created customized dashboards and automated configuration service and system performance and health monitoring by configuring Nagios monitoring server environment for tracking wizards and generating reports

Designed the infrastructure and administered the environment running over multiple ESXi Hosts and hundreds of virtual Machines using vSphere Client. Developed automation and deployment utilities using Bash, PowerShell, scheduled tasks, and system backups using Python on RHEL

Experience in deployment of JIRA applications into existing/default VPC and configuring Amazon Elastic File System to sort the artifacts that can be accessed through multiple nodes for High Availability. Involved in all phases of Software development life cycle (SDLC) and experienced with fast-paced Agile methodologies.

Comerica, Dallas, TX Mar 2015 – Jan 2017

Systems Platform Engineer

Planning, deploying, monitoring, and maintaining AWS cloud infrastructure consisting of multiple EC2 nodes and VMware as required in the environment

Designed AWS CloudFormation templates to create custom sized VPC, subnets, and NAT to ensure successful deployment of Web applications and database templates. Designed roles and groups for users and resources using AWS Identity Access Management (IAM) and also managed network security using Security Groups, and IAM.

Worked on AWS ELB and configure the auto-scaling as per the application user traffic and managed the multi-tier and multi-region architecture using AWS CloudFormation

Used AWS Code Pipeline, cloud formation, EC2, and Lamda CloudWatch services to deploy applications in different environments in AWS Infrastructure.

Building and Installing servers through Azure Resource Manager Templates (ARM)maintained Oracle and NoSQL databases (MongoDB, Cassandra) in the production domain

Creating and maintaining containerized microservices and configuring/maintaining a private container registry on Microsoft Azure for Hosting Images and using Windows Active Directory.

Configure Role-Based Access Control (RBAC) for Azure Resources and worked in Setting up Hybrid connections between Azure web pass and on-premises SQL databases

Created Chef Recipes for Infrastructure maintenance on VMwareextensive use of Splunk, Nagios, SiteScope New Relic, and Splunk to debug Prod issues.

Configure and build Open Stack Havana, and Icehouse using Ansible and Python scripts. Tested and implemented applications built using Python

Implemented Micro-services using the Private Cloud Foundry (PCF) platform build upon Spring Boot Services and created workflows on TeamCity for setting up automated pipelines for CI/CD with PCF.

Ensured, successful architecture and deployment of enterprise-grade PaaS solutions using Private Cloud Foundry (PCF) as well as proper operation during initial Application migration and net new development PCF

Container management using Docker by writing Docker files and setting up the automated build on Docker HUB and installing and configuring Kubernetes.

Hands-on experience with Docker hub, creating Docker images and handling multiple images primarily for middleware installations and domain configurations

Developed several playbooks using Ansible and deployed the applications/services on the client hosts. Worked on Ansible setup, managing hosts file, Using YAML linter, and authoring various playbooks and custom modules with Ansible.

Administration of Continuous Integration tool in Jenkins. Create and configure new jobs for each and every application in Jenkins based on technology stacks

Managed Version Control Subversion (SVN) and GitHub Enterprise and Automated current build process with Jenkins with proposed Branching strategies to accommodate code in various testing cycles

Used Nagios as a monitoring tool to identify and resolve infrastructure problems before they affect critical processes and also worked on Nagios Event handlers in case of automatic restart of failed applications and services

Used and Administered Continuous Integration tools, Jenkins & Hudson. Build, configured, and supported Application team environments. Maintained and upgraded Jira issue tracker, and Crucible code review tool.

Managed and maintained the TFS server. Customize Work Items, Process Templates, Build Definition Templates and TFS Reports Experience Installing, configuring, and upgrading WebLogic, Tomcat & JBoss application server

Deployed Red Hat Enterprise Linux 6.x/7.x, Cent OS and installation of packages and patches for Red Hat Linux Servers



Contact this candidate