Resume

Sign in

Hadoop Administrator

Location:
Hyderabad, Telangana, India
Salary:
6L
Posted:
April 21, 2019

Contact this candidate

Resume:

Chandan Varma

E-mail: ac854w@r.postjobfree.com Mobile: +91-800*******

Hadoop Bigdata Administrator

Professional Summary:

A Seasoned Systems Adminstrator with in depth knowledge and extensive experience in managing Linux based servers and Big Data Clusters.

Hands-on experience in managing Hadoop architecture, design & development in Big Data which include large clusters and Hadoop Ecosystem projects

Setup Big Data Clusters using distributions like Cloudera, Hortonworks, MapR

Knowledge on Cloudera & Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Hive, Zookeeper, Sqoop, Pig, Hue, HA and Security)

Significant exposure in installing Hadoop & its related components in a multi-node cluster environment

Possess sound knowledge of working on HDFS Architecture & Cluster, Cron Jobs Scheduler, AWK & SED commands in UNIX

Server automation using tools like Ansible, Chef, Shell Scripting, etc.

Proficiency in developing Oozie workflow and exporting & importing data from Sqoop to Hive Tables

Ability to setup Big Data Clusters on AWS, GCP, OVH for client proof of concepts

Key Skills:

Primary Skill Category

Hadoop Administration, HDFS, YARN, Hive, Pig, MapReduce, Sqoop, Oozie, Impala, Cloudera Manager, Ambari.

Sub Skills

Linux/Unix

Configuration Management Tools

Ansible, Chef

Monitoring Tools

Cloudera Manager, Ambari

Frame Works

Hadoop MapReduce

Work Experience:

Company Name: ITVersity

Designation: Hadoop Administrator

Duration: Jan 2018 - Present

Responsibilities:

Knowledge of Big Data Ecosystem components

An active participant in Big Data community https://discuss.itversity.com

Setting up and Managing Big Data Cluster

Handled Upgrading (HDP 2.5 to HDP 2.6) of the real-time cluster with 1000 users.

Handling tasks like System monitoring - HDFS Disk utilization and long-running jobs.

Setting up a 6-node Cloudera (CDH5) cluster for labs.

Root cause analysis for system failures by looking into the logs.

Setting up Big Data Clusters on Cloud Platforms

Knowledge in provisioning servers from AWS and Google Cloud to build multi-node big data clusters

Designed 4-node cluster on AWS using Cloudera Distribution, 6-node cluster on Hortonworks distribution for clients.

Provisioning Dedicated and cloud servers from OVH

Worked with DevOps tools - Ansible, Chef, and Vagrant

Training Interns and newcomers in Hadoop administration and troubleshooting issues.

Having knowledge on Installation and configuration of cloudera hadoop on single or cluster environment.

Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.

Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and network

Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.

Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.

Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement

As a admin followed standard Back up policies to make sure the high availability of cluster.

Project Details:

Hadoop Cluster Setup on Amazon Web Services

Setup, installation, configuration and Administration of 15-node CDH5.2 Hadoop cluster on Amazon Ec2 instances to implement a proof of concept using Spark for media and information firm

ITVersity Big Data CoE cluster setup

Setup, installation, configuration and Administration of 12-node CDH4.X & CDH5.X Hadoop cluster and 6-node HDP2.0 cluster, recently upgraded to HDP3.0

Bigdata Platform Setup, Administration and Support

21-nodes Production, 12-node Dev/QA CDH 4.1.3 Hadoop clusters set-up for US Financial Major.

Company Name: VonExpy Softech Private Limited

Designation: Linux System Administrator

Duration: June 2016 – Dec 2017

Responsibilities:

The primary responsibility is to carry out day-to-day tasks of System Administration and Monitoring and updating Tickets (issues) through Incident management system.

Responsible for installation, configuration, management and maintenance over Linux systems.

Remote Administration of Linux server using ssh, vnc viewer.

Remote Administration of Manageable Routers & Switches with Telnet and SSH

Package Management using RPM & YUM, Disk Management: Partitioning tools like fdisk, parted etc.

Configure IP addresses, Subnet Masks and Gateway Addresses on Routers and Hosts.

Administrations of Users and Groups.

Scheduling jobs using Crontab.

Certifications:

Red Hat Certified System Administrator (RHCSA), Certification No: 170-235-501

Education:

Degree

Specialization

University

Year of passing

Graduation

BTECH (CSE)

Saveetha University (Chennai)

2016

Personal Details:

Birth Date

19-10-1994

Languages Known

English, Telugu, Hindi and Tamil

Passport No.

P4329701



Contact this candidate