E-mail: firstname.lastname@example.org Mobile: +91-800*******
Hadoop Bigdata Administrator
A Seasoned Systems Adminstrator with in depth knowledge and extensive experience in managing Linux based servers and Big Data Clusters.
Hands-on experience in managing Hadoop architecture, design & development in Big Data which include large clusters and Hadoop Ecosystem projects
Setup Big Data Clusters using distributions like Cloudera, Hortonworks, MapR
Knowledge on Cloudera & Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Hive, Zookeeper, Sqoop, Pig, Hue, HA and Security)
Significant exposure in installing Hadoop & its related components in a multi-node cluster environment
Possess sound knowledge of working on HDFS Architecture & Cluster, Cron Jobs Scheduler, AWK & SED commands in UNIX
Server automation using tools like Ansible, Chef, Shell Scripting, etc.
Proficiency in developing Oozie workflow and exporting & importing data from Sqoop to Hive Tables
Ability to setup Big Data Clusters on AWS, GCP, OVH for client proof of concepts
Primary Skill Category
Hadoop Administration, HDFS, YARN, Hive, Pig, MapReduce, Sqoop, Oozie, Impala, Cloudera Manager, Ambari.
Configuration Management Tools
Cloudera Manager, Ambari
Company Name: ITVersity
Designation: Hadoop Administrator
Duration: Jan 2018 - Present
Knowledge of Big Data Ecosystem components
An active participant in Big Data community https://discuss.itversity.com
Setting up and Managing Big Data Cluster
Handled Upgrading (HDP 2.5 to HDP 2.6) of the real-time cluster with 1000 users.
Handling tasks like System monitoring - HDFS Disk utilization and long-running jobs.
Setting up a 6-node Cloudera (CDH5) cluster for labs.
Root cause analysis for system failures by looking into the logs.
Setting up Big Data Clusters on Cloud Platforms
Knowledge in provisioning servers from AWS and Google Cloud to build multi-node big data clusters
Designed 4-node cluster on AWS using Cloudera Distribution, 6-node cluster on Hortonworks distribution for clients.
Provisioning Dedicated and cloud servers from OVH
Worked with DevOps tools - Ansible, Chef, and Vagrant
Training Interns and newcomers in Hadoop administration and troubleshooting issues.
Having knowledge on Installation and configuration of cloudera hadoop on single or cluster environment.
Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and network
Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement
As a admin followed standard Back up policies to make sure the high availability of cluster.
Hadoop Cluster Setup on Amazon Web Services
Setup, installation, configuration and Administration of 15-node CDH5.2 Hadoop cluster on Amazon Ec2 instances to implement a proof of concept using Spark for media and information firm
ITVersity Big Data CoE cluster setup
Setup, installation, configuration and Administration of 12-node CDH4.X & CDH5.X Hadoop cluster and 6-node HDP2.0 cluster, recently upgraded to HDP3.0
Bigdata Platform Setup, Administration and Support
21-nodes Production, 12-node Dev/QA CDH 4.1.3 Hadoop clusters set-up for US Financial Major.
Company Name: VonExpy Softech Private Limited
Designation: Linux System Administrator
Duration: June 2016 – Dec 2017
The primary responsibility is to carry out day-to-day tasks of System Administration and Monitoring and updating Tickets (issues) through Incident management system.
Responsible for installation, configuration, management and maintenance over Linux systems.
Remote Administration of Linux server using ssh, vnc viewer.
Remote Administration of Manageable Routers & Switches with Telnet and SSH
Package Management using RPM & YUM, Disk Management: Partitioning tools like fdisk, parted etc.
Configure IP addresses, Subnet Masks and Gateway Addresses on Routers and Hosts.
Administrations of Users and Groups.
Scheduling jobs using Crontab.
Red Hat Certified System Administrator (RHCSA), Certification No: 170-235-501
Year of passing
Saveetha University (Chennai)
English, Telugu, Hindi and Tamil