Manager Hadoop

Shoaib Shaikh

Phone: +91-823*******

E-Mail: ***********@*****.***

Hadoop Administration

Achievement-driven professional with 4+ years of experience in Hadoop Administration across Retail domain

Industry Preference: IT Location Preference: Across India

ǁ Profile Snapshot ǁǁǁǁǁǁ

Knowledge on Cloudera Hadoop distribution (HDFS, YARN, MapReduce, Hive, Zookeeper, Sqoop, Pig, Hue, Cloudera Manager, Cloudera Director, HA and Security)

Knowledge on working with Amazon AWS Platform components such as EC2, S3, EMR

Proficiency in developing Oozie workflow and exporting & importing data from Sqoop to Hive Tables

Hands-on experience in managing Hadoop architecture, design & development in Big Data which include large clusters and Hadoop Ecosystem projects

Practical knowledge in debugging & administration of Hadoop ECO Tools such as Sqoop, Pig, Hive & Oozie

Also have good knowledge of Hortonworks, Ambari manger.

Significant exposure in installing Hadoop & its related components in a multi-node cluster environment

Good knowledge of security management using Active Directory Kerberos

Skills in working on health check monitoring tools of cluster such as Nagios and Ganglia

Possess sound knowledge of working on HDFS Architecture & Cluster, Cron Jobs Scheduler, AWK & SED commands in UNIX

Good knowledge in analysing and writing the SQL queries

Proven interpersonal, communication & presentation skills with the ability to work under pressure

ǁ Key Skills ǁǁǁǁǁǁ

~Hadoop Administration ~System Administration

~Installation & Commissioning ~Security Management

~Client Relationship Management ~Liason & Coordination

ǁ Work Experience ǁǁǁǁǁǁ

Since June 15 Ample Softech Ltd., Pune as Hadoop Administrator

Key Result Areas:

Performing cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager, Cloudera Director

Carrying out performance tuning of Hadoop clusters and Hadoop Applications

Monitoring the cluster alerts and notifications using tools such as Ganglia, Nagios, Cloudera Manager, and so on

Screening Hadoop cluster job performances and capacity planning

Monitoring Hadoop cluster connectivity and security

Managing and reviewing Hadoop log files

Maintaining the Incidents and CR as part of support

Anticipating problems and taking decisive action to solve the issues without impact on both development clusters and production cluster

Directing implementation and ongoing administration of Hadoop infrastructure

Collaborating with data delivery teams to set-up new Hadoop users

Setting up Linux users and testing HDFS, Hive, Pig & MapReduce access for the new users

Communicating with all levels of management and actively participate on leadership teams

Working closely with the client and developing & maintaining cordial relationships with clients

Accomplishment:

Conferred with Ample Star Award for outstanding performance 2016-Q1

Project Undertaken:

Title: IKEA – Development, Support & Enhancement

Period: Sep’15 – Till Date

Designation: Hadoop Administrator

Project Description: IKEA is Swedish Retail Company founded by Ingvar Kamprad in 1943 as a mostly mail-order sales business. It began to sell furniture five years later. The first IKEA store was opened in Älmhult, in 1958, while the first stores outside Sweden were opened in Norway (1963) and Denmark (1969). The stores spread to other parts of Europe in the 1970s, with the first store outside Scandinavia opening in Switzerland (1973), followed by West Germany (1974). And IKEA is started to spread the business in India as well by opening a store in Hyderabad by 2017 as first store in India. IKEA owns and operates 373 stores in 47 countries.

Roles:

Implementing & administering Hadoop infrastructure

Maintaining Production (Elmhult) Cluster and 2 clusters for Development & PPE Testing environments

Managing the alerts from cluster monitoring tools like Ganglia, Nagios and Cloudera manager

Preparing & performing the installation of Hadoop software

Adding & configuring the nodes; monitoring cluster health and troubleshooting the same

Managing metadata databases and reviewing backups

Moving data between clusters by using Distributed Copy

Rebalancing of the HDFS

Scheduling statistics runs and automating the same

Disk space management and monitoring

Directing quota administration and notification in case of space problems

Working together with infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability

Processing the events of Hadoop logs, taking measures, correcting errors and involving the relevant teams if necessary

Tuning by making changes to settings through Hive, Sqoop, and so on

Creating weekly & monthly status and WOM reports; coordinating with higher management & clients during the meetings about the key points mentioned in reports, taking required actions and implementing as per the suggestions

Implementing the new shell scripts for daily clean-up activities and scheduling them by using Crontab command

Fixing Hadoop job failures

ǁ Education ǁǁǁǁǁǁ

• Master in Computer Applications from MMCOE, Pune, Pune University.

• Bachelor in Computer Applications from Poona College, Pune.

• 12th from SCSM College Shrigonda, Ahmednagar, Maharashtra Board

• 10th from Dnyandeep School Shrigonda, Ahmednagar, Maharashtra Board

ǁ IT Skills ǁǁǁǁǁǁ

Language: C, Core Java

Operating Systems: Linix and Windows

Database: Oracle (SQL) and Hadoop

Reporting Tool: Cognos

Third Party Tools: Sqoop, Hive, PIG and Oozie

ǁ Personal Details ǁǁǁǁǁǁ

Date of Birth: 15th December 1990

Languages Known: English, Hindi, Marathi

Mailing Address: Main Road, Shivaji Chowk, Shrigonda, Ahmednagar – 413701, Maharashtra

Contact this candidate