Venkatesh V
Devops/Elk Stack Engineer
*******.******@*****.***
Contact no: 510-***-****
Summary:
Over 7 years of extensive experience in the IT industry, involved in all Phases of Project life Cycle (SDLC) and Agile Analysis, Design, Development, Testing, Documentation Which unites into the field of Devops and AWS with skill in Linux Administration, Continuous Integration, Configuration Management, Automation and Monitoring technologies for financial and insurance domain.
Installation, Maintenance, Administration and troubleshooting of Linux, windows servers Performed automated installations of Operating System using kick start for Linux
Experienced with setup, configuration and maintain ELK stack (Elasticsearch, Logstash and Kibana) and OpenGrok source code (SCM)
Good understanding of the principles and best practices of Software Configuration Management (SCM) in Agile, scrum, and Waterfall methodologies.
Expertise in implementing the Configuration Management using tools like Chef, Puppet and Ansible.
Experienced in working with configuration management tool Puppet that includes the installation and configuration of the Puppet master, agent nodes and an admin control workstation.
Experience in Administration/Maintenance of Source Control Management Systems such as Git, Sub Version (SVN). Created tags and branches, fixed merge issues and administered software repositories.
Managed and configured (Amazon Web Services) cloud services like EC2, S3bucket, Security groups, RDS, EBS, ELB, Auto-Scaling, AMI, Elastic search, IAM through AWS Console and API Integration.
Designed and managed public/private cloud infrastructures using Amazon Web Services (AWS) which include EC2, S3, Cloud Front, Elastic File System, RDS, VPC, Direct Connect, Route53, Cloud Watch, Cloud Trail, Cloud Formation, and IAM which allowed automated operations.
Separate Java URL’s Data from Elasticsearch-1.4.3 Cluster and transfer to Elasticsearch-5.6.4 cluster Using Logstash, Kafka.
Working with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Elasticsearch tuning based on our application needs.
Responsible to designing and deploying new ELK clusters (Elasticsearch, Logstash, Kibana, beats, Kafka, zookeeper etc.
Design, build and manage the ELK (Elasticsearch, Logstash, and Kibana) cluster for centralized logging and search functionalities for the App.
Written and Maintained Automated Salt scripts for Elasticsearch, Logstash, Kibana, and Beats. Expertise in Repository Management tools Jfrog, Artifactory, and Nexus.
Real time streaming of data using Spark with Kafka.
Skilled in monitoring servers using Nagios, Data dog, Cloud watch and using EFK Stack Elasticsearch Fluentd Kibana.
Experience with Virtualization technologies like installing, configuring, VMware vSphere. Creation, management, Administration and maintenance of virtual servers and clients.
Extensive engineering and implementation knowledge in Solaris, Red hat Linux and AIX.
Experience in System Administration System Builds, Server builds, Installs, Upgrades, Patches, Migration, Troubleshooting, Security, Backup, Disaster Recovery, Performance Monitoring and Fine-tuning on UNIX.
Excellent interpersonal, good analytical and communication skills with ability to work independently with minimal supervision and perform as part of a team.
Performed all necessary day-to-day GIT support for different projects and expert in creating branching strategies to maintain GIT repository.
Skilled in monitoring servers using Nagios, Cloud watch and using ELK Stack Elasticsearch Fluentd Kibana.
Worked with Kubernetes to manage Docker containers and Implemented CI/CD allowing for deploy to multiple client Kubernetes/AWS environments.
Technical Skills:
Operating Systems
Linux Red Hat, Linux CentOS, Ubuntu, Unix, Windows, AIX
Version Control Tools
SVN, GIT, TFS, CVS and IBM Rational Clear Case
Automation Tools
Jenkins/Hudson, Build Forge and Bamboo, Salt Stack, GitHub
Build Tools
Maven, Ant and MS Build
Configuration Tools
Chef, Puppet, Salt Stack and Ansible
SQL/No-SQL Databases
Oracle, Teradata, MongoDB, Dynamo DB
Bug Tracking Tools
JIRA, Remedy, HP Quality Centre and IBM Clear Quest
Scripting
Shell, Ruby, Python and JavaScript
Virtualization Tools
Docker, VM virtual Box and VMware
Monitoring Tools
Nagios, Cloud watch, Splunk
Cloud Platform
AWS EC2, VPC, EBS, Cloud Formation AWS Config and S3
Education:
Master’s in Computers.
Bachelor’s in Computers
Work Experience:
Sr. Devops/Elasticsearch Engineer June’17 to Present
Apple Inc. -Sunnyvale, CA
Responsibilities:
Implement a production ready, load balanced, available and fault tolerant Kubernetes infrastructure.
Responsible for leading Devops engineering, AWS architecture, continuous integration and deployments.
Build expertise in Workflow for Amazon Web services including Security Groups, IAM, EC2, S3, ELB, EBS, Policy, VPC, Docker, Kubernetes, Cloud Formation, Chef, Jenkins Vagrant, Apache, Tomcat, Git and GitHub.
Designing and deploying a multitude of applications utilizing almost all the AWS stack (Including EC2, Route53, S3, RDS, Dynamo DB, SNS, SQS, IAM) focusing on high-availability, fault tolerance, and auto scaling in AWS Cloud formation.
Migrating a production infrastructure into an Amazon Web Services utilizing AWS Cloud Formation, Code Deploy, EBS and Ops Works.
Implemented rapid-provisioning and life-cycle management for Ubuntu Linux using Amazon EC2, Chef, and custom Ruby/Bash script.
Configured xpack for the security and monitoring of our cluster and created watches to check for the health and availability of the nodes.
Created users for application teams to view their logs using curl statements and provided only the read access to them.
Skilled in monitoring servers using Nagios, Cloud watch and using ELK Stack Elasticsearch Fluentd Kibana.
Maintained JIRA for tracking and updating project defects and tasks ensuring the successful completion of tasks in sprint.
Installed and configured Nagios monitoring tool, while using it for monitoring network services and hosts resources.
Worked with Jenkins API's to know various things like build status, count of builds, Git commit version used by Jenkins builds etc. using Groovy.
Used Docker for packaging applications and designed the entire cycle of application development and used Virtualized Platforms for Deployment of containerization of multiple apps.
Developed procedures to unify, streamline and automate application development and deployment procedures with CLI and Linux container technology using Docker (POC).
Migrate Data from Elasticsearch-1.4.3 Cluster to Elasticsearch-5.6.4 using Logstash, Kafka for all environments.
Infrastructure design for the ELK Clusters.
Elasticsearch and Logstash performance and configuration tuning.
Identify and remedy any indexing issues.
Provided design recommendations and thought leadership to improved review processes and resolved technical problems.
Working with product managers to architect the next generation of Workday search.
Benchmark Elasticsearch-5.6.4 for the required scenarios.
Using X-pack for monitoring, Security on Elasticsearch-5.6.4 cluster.
Providing Global Search with Elasticsearch
Written watcher alerts based on required scenarios.
Developed APIs for integration with various data sources.
Implemented cloud-based integrations with elastic.
Build visualization and Dashboards using Kibana.
Manage regular changes in priority due to customer priority changes.
Implemented Disaster management for creating Elasticsearch clusters in two DC and configure Logstash to send same data to two clusters from Kafka.
Environment: Git, Jenkins, Docker, Kubernetes, Chef, Maven, AWS, EC2, RDS, EBS, Nagios, Elastic Load Balancer, Ruby, Elasticsearch, Td-agent(Fluentd),Logstash, Kibana.
Devops/Elasticsearch Engineer Apr’16 to June’17
Sling TV– American Fork, UT
Responsibilities:
Working with broad range of AWS Cloud Services like EC2, ELB, Glacier, Cloud Front, Code Deploy, Elastic Beanstalk, Auto Scaling, Route53, AMI, SNS, SQS, DynamoDB, Elastic search and Cloudwatch and have in depth practical knowledge on other cloud services.
Involved in creating IAM user accounts, groups, adding user to the groups, generating custom policies, assigning to groups and users.
Automated the installation of Cloud Watch log agents through cloud formation template to monitor the system logs of multiple EC2 instances.
Created snapshots and Amazon Machine Images (AMI) of the instance for backup and created access Management (IAM) policies for delegated administration within AWS.
Used EC2 as virtual servers to host Git, Jenkins and configuration management tool like Ansible. Converted slow and manual procedures to dynamic API generated procedures.
Maintained DNS records using Route53 to Improve Fault Tolerant Connections and using Load balancer, Security groups.
Created Python scripts to fully automate AWS services which include ELB, Cloud Front distribution, EC2, Security Groups and S3. This script creates stacks, singe servers and joins web servers to stacks.
Worked with Docker Container, container snapshots, attaching to a running container, managing containers, and directory structures and removing Docker images.
Worked on Docked-Compose, Docker-Machine to create Docker containers for testing applications in the QA environment and automated the deployments, scaling and management of containerized applications across clusters of hosts using Kubernetes.
Worked with containerization tools, can implement transition to Docker and develop distributed cloud system using Kubernetes and Helm package manager for Kubernetes.
Used Ansible server to manage and configure nodes, Managed Ansible Playbooks with Ansible roles. Used file module in Ansible playbook to copy and remove files on remote systems.
Responsible for large-scale Chef Implementation and maintenance, Chef Cookbook's creation, testing and implementation.
Setup Continuous Integration environment using Jenkins for building jobs and to push the Artifacts into Nexus repository on successful builds.
Worked with Jenkins API's to know various things like build status, count of builds, Git commit version used by Jenkins builds etc. using Groovy.
Installed and Configured Data Base Servers like MySQL, MariaDB, PostgreSQL, MongoDB, Cassandra, Oracle DB (10g, 11g), on various Linux Distributions, Oracle Enterprise Linux, RedHat Enterprise Linux, Ubuntu Enterprise Linux.
Worked on branching, labelling, and merging strategies for all applications in Git.
Used Bitbucket to manage repositories, maintained the branching and build/release strategies utilizing GIT and Bitbucket.
Maintained JIRA for tracking and updating project defects and tasks ensuring the successful completion of tasks in sprint.
Installed and configured Nagios monitoring tool, while using it for monitoring network services and hosts resources.
Responsible to designing and deploying new ELK clusters (Elasticsearch, Logstash, Kibana, beats, Kafka, zookeeper etc.
Design, build and manage the ELK (Elasticsearch, Logstash, and Kibana) cluster for centralized logging and search functionalities for the App.
Responsible for designing and deploying new ELK clusters (Elasticsearch, Logstash, Kibana, beats, Kafka, zookeeper etc.
Written and Maintained Automated Salt scripts for Elasticsearch, Logstash, Kibana, and Beats.
Experience in Kibana in data visualization and monitoring Cluster and performance through X-pack.
Experience in building data dictionary, functions and synonyms for NoSQL (Elasticsearch).
Created stored procedures to import data in to Elasticsearch engine.
Worked closely with application teams and support on various performance and configuration issues on daily basis.
Environment: AWS, GIT, Jenkins, Chef, Ansible, Terraform, Kubernetes, Docker, Nagios, Jira, Java/J2EE, Maven, Apache Tomcat, Splunk, Python, Bash, Linux.
Linux Admin Jun’13 to Aug’15
Knoahsoft – Hyderabad, India
Responsibilities:
Installation, Configuration and administration of DNS, LDAP, NFS, NIS, NIS+ and Sendmail on Redhat Linux/Debian Servers. Configured, managed ESX VM's with virtual centre and VI client.
Setup Continuous Integration by configuring Build, Code coverage, deploy and test automation Jobs in Jenkins for different applications and worked with different teams in enterprise level to resolve the errors.
Used AGILE MAVEN method to develop a build and also ANT as a build tool.
Involved in writing parent pom.xml files to establish the code quality tools integration.
Troubleshoot the Chef bootstrap issues and errors while performing provision and deployments using Chef.
Use Blade logic Configuration Manager to upgrade Solaris and Linux operating Systems as well as update firmware, HBA, EMCpower and Bank tools through Bladelogic.
Written NSH script in Bladelogic to create Falr image and Tar file backups for Solaris and Linux Servers.
Setup Continuous Integration by configuring Build, Code coverage, deploy and test automation Jobs in Jenkins for different applications and worked with different teams in enterprise level to resolve the errors.
Troubleshoot the Chef bootstrap issues and errors while performing provision and deployments using Chef.
Customized Ansible role for automated deployments of the Dynatrace Java Agent for Glassfish.
Performed POC and Upgraded the environments from java 1.7 to java 1.8, tomcat 7 to tomcat 8, AMI upgrades.
Performed patching and OS upgrades (rebuilds) and associate hardware break/fix, triage and software Installations related to the patching and OS upgrade activities.
Provisioned and build CHP (compute host platform) Red hat Linux 6.1 virtual machines, these servers based cloud computing.
Provided rotational on call responsibilities to support issues that arises as the result of patching, upgrades or server rebuilds performed by the team.
Documented installation procedures, changes required in present environment and Provide server remediation to ensure all vulnerabilities have been addressed.
Working on Chef Configuration Management Tool written in Ruby which involves automation of systems administrator tasks and knife usage.
Configured LDAP clients on server test and troubleshoot for maintaining network and data security.
Creating backup policies for Flat File, Oracle Database, Microsoft Sql Server and IBM Lotus Notes.
Managed multiple MongoDB (NoSQL) database clusters. Planned and implemented backup and recovery of the Mongo databases.
Environment: Red-Hat Linux Enterprise servers (HP ProLiant DL 585, BL 465/485, MLSeries, Solaris 8,9,10, DNS, LDAP, NFS, NIS, Bash/KORN Shells, NIS+, ANT, Agile Maven, Chef, Git, Bitbucket, Jenkins, Tomcat 7&8, AWS and JIRA.
Linux Admin Aug 10 to May’13
Micro land– Bengaluru, India
Responsibilities:
Develop, host, troubleshoot and maintain client web sites using SuSE Linux.
Installation, configuration and upgrade SUSE Linux 10/11/12, RedHat Linux 5/6/7 and operating systems Solaris 9/10/11.
Installing Configuration and maintenance of Solaris 9/10/11, RedHat Linux 4/5/6, SUSE 10.3, 11.1, HP-UX 11.x and IBM AIX operating systems.
Worked on configurations and installations Solaris and Linux servers using Custom Jumpstart and Kick start.
Extensive experience in installation, configuration, maintenance, design, development, implementation, and support on SuSE Linux [ ] and Linux RHEL 5/6/7 Environments.
Handling the day-to-day Operations, Install software, apply patches, manage file systems, monitoring performance and troubleshoot alerts.
Managed patches configuration, version control, service pack and reviews connectivity issues regarding security problems.
Build Yum and RPM repository Server for Development team to upload packages, Written UNIX Shell scripts for monitoring & clean up old files.
Maintained virtual environments using VMware ESX 4.x Server and built various Linux servers on VMware servers.
Attended team meetings, change control meetings to update installation progress, and for upcoming change in environment.
Responsible to solve technical Problems related to System administration.
Maintaining and Troubleshooting of FTP Server, Samba Server of the client.
Handling the day-to-day Operations, Troubleshooting& Solve Server Problems in LINUX.
Storage setups, RAID, Logical Volume Manager, system backup design and disaster recovery Systems performance monitoring.
Worked elaborately on different windows environment which include Windows NT version 4.0, Work Station, Terminal, 2000 and 2003.
Worked closely with database administration staff to ensure optimal performance of databases, and maintain development applications and databases.
Environment: Red Hat Linux 3.x/4.x/5.x,CentOS 4.6/4.7/5, Windows 2003/2008 R2, VMware ESX 4.0, NFS, Software RAID, DNS Servers Centos 5.7/6, Redhat Linux 5.7/6, Ubuntu 10.04/10.10/11.10, Fedora 17, VMware, SAN (EMC, Hitachi), NAS.