Manager Hadoop

Swetha Ravinuthala

******.*************@*****.***

Professional Summary

Around 6 years of professional experience in Hadoop administration activities such as installation and configuration of clusters using Apache, Cloudera, Hortonworks and hands on experience as database administration and Linux system.

Setting up automated 24x7 monitoring and escalation infrastructure for Hadoop cluster

Experience with Horton works & Cloudera Manager Administration also experience in Installing, Updating Hadoop and its related components in Single node cluster as well as Multi node cluster environment using Apache, Cloudera, Horton works.

Ability to prepare documents including Technical Design, testing strategy, and supporting documents.

Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.

Installation of various Hadoop Ecosystems and Hadoop Daemons.

Experience with Hardware, Storage, Networking, Active Directory/Kerberos.

Worked with different applications teams to integrate with Hadoop.

Experience in deploying and managing the multi-node development and production Hadoop cluster with different Hadoop components using Ambari, Cloudera.

Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.

Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster.

Good experience on Design, configure and manage the backup and disaster recovery for Hadoop data

Hands on experience on major components in Hadoop Ecosystem including HDFS and MapReduce framework, YARN, HBase, Hive, Pig, Scoop, Zookeeper.

Experience in managing and handling Linux platform servers and hands on experience on Red hat Linux.

Knowledge in Linux, Shell Scripting, RDBMS, NoSQL.

Hadoop Technologies:

HDFS, Map Reduce, Pig, Hive, HBase, Sqoop, zookeeper, flume.

Databases

Db2 LUW, Netezza, MySql.

Operating Systems:

Linux RHEL/Centos, Windows.

Monitoring Tools:

Cloudera Manager, Ambari.

Scripting Languages

Shell scripting.

Office Tools:

MS Word, MS Excel, MS PowerPoint.

Technical Skills:

Professional Experience

USAA, Dallas, TX June 2018 -August 2020

Hadoop Administrator

Responsibilities:

Responsible for Hadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster and Cluster maintenance, commissioning and decommissioning Data nodes.

Day-to-day activities includes troubleshooting, manage and review Hadoop log files. Involve in Analyzing system failures, identifying root causes, and recommended course of actions. Documenting the systems processes and procedures for future references. Involved in cluster capacity planning, Hardware planning, Installation, Performance tuning of the Hadoop cluster.

Monitored workload, job performance and capacity planning. Involved in migration activities.

Installation of various Hadoop Ecosystems like HDFS and MR framework, YARN, HBase, Hive, Pig, Scoop, Zookeeper and Hadoop Daemons.

Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades.

Monitors the Hadoop jobs and performance.

Performed on call duties, and responsible for Hadoop Cluster monitoring using the tools like Ambari, Ganglia, Nagios and Cloudera Manager.

Worked with data delivery teams to setup new Hadoop users, Linux users, setting up Kerberos principles and testing.

Experienced in managing and reviewing Hadoop log files.

Monitoring systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.

Worked with different applications teams to integrate with Hadoop.

Worked with Hardware, Storage, Networking, Active Directory/Kerberos.

Handled importing of data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.

Environment: Hadoop HDFS, YARN, Map Reduce, Hive, Pig, Zookeeper, HBase, Flume, Linux, Ambari, Cloudera Manager, Linux.

Ezcorp, Austin, TX December 2016 -April 2018

Hadoop Administrator

Responsibilities:

Involved on Hadoop Cluster capacity planning, performance tuning, cluster monitoring, Troubleshooting, Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster. Starting and stopping the Hadoop demons like Name node, Standby name node, data node, Resource Manager, Node Manager.

Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement

Created user accounts and given users the access to the Hadoop cluster.

Importing and exporting data into HDFS using Sqoop and file system to HDFS.

Adding/installation of new components and removal of them through Ambari.

Resolving tickets submitted by users, troubleshoot the error documenting, resolving the errors.

Trouble shooting issues such as Data Node down, Network failure and data block missing.

System/cluster configuration and health check-up.

Experienced in managing and reviewing Hadoop log files.

Responsible for Cluster maintenance, Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.

Environment: Hadoop HDFS, Map Reduce, Hive, Pig, Zookeeper, HBase, Flume, Sqoop, Linux, Ambari.

HCL Technologies, Chennai, India June 2015 -November 2016

Netezza DBA

Responsibilities:

Responsible for Database maintenance activities such as start and stop NPS server, database vacuum and catalog cleaning on and off. Monitoring the disk utilization and checking for hardware issues. Day-to-day activities include performing Daily database backup activities using backup and restore utilities.

Monitoring database performance nzsession, nzsystem, nzskew, nzstats and nz health utilities to monitoring the skew and distribution of all tables, NPS server issue for better performance.

Schedule the jobs to take backup, restore, generate statistics, grooms, nzmigrate etc. using CRONTAB scheduler.

Environment: Netezza 7.01, Aginity, Linux.

Bharat Dynamics Limited, India March 2014 – March 2015

Junior Db2 DBA

Responsibilities:

DDL implementation and changes for database objects. Worked on explain, db2advis, taking snapshots, running list applications, checking the memory, backups and restores etc.

Strong understanding of database shared memory parameters and tuning memory parameters in Db and Dbm cfg.

Creation of database with disaster recovery with HADR and QREP in production.

Environment: Db2udb, Linux

Education

GITAM University, India - Bachelor of Science (Computer Science)

Contact this candidate