Data Developer

Mangesh Nila E-Mail: *********@*****.***

Phone: +91-960*******

OBJECTIVE:

Big Data Expert – Hadoop Developer

Seeking a Hadoop Developer position where I can utilize my skills and abilities in the industry that offers

Security and professional growth while being resourceful, innovative and flexible with team spirit.

WORK EXPERIENCE

Internship at:

Big Logiic Technologiess. (1.2 years)

FROM: March 2015 – Till now

DESIGNATION: Junior Developer (Trainee)

CLUSTER SPECIFICATION:

Data Size: 10TB

Cluster Architecture: Fully Distributed

Package Used: CDH5.7

Cluster Capacity: 39.5 TB ~ 40 TB approx.

No. of Nodes: 26 Data Nodes + 3 Masters + NFS Backup For NN

Role - 1

Map Reduce Programming for various Use Cases, Installing and maintaining a Hadoop cluster. Development using Hadoop, YARN, HDFS, Sqoop, Pig And Hive

Role - 2

Conducting Awareness Programs and Meetups, Expanding Business Prospects for Big Logiic Technologies in Pune City for Training and Development.

Projects:

Project 1: MKCL, Pune (Maharashtra Knowledge Corporation Limited).

Hadoop Cluster Deployment

Installing Hadoop Cluster and related applications and certifying them. Installed multi-node fully distributed cluster with MR, Hive, Hue, Sqoop.

Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement.

Enabled Hadoop task monitoring feature. Design, develop, and manage data on Hadoop cluster

Commissioning and Decommissioning the Nodes on cluster, Data Rebalancing.

Manage nodes on Hadoop cluster End-to-end performance tuning of Hadoop clusters and Hadoop Map/Reduce routines against very large data sets HDFS support and maintenance.

Maintaining backups for name node.

Recovering from a NameNode failure Setup of standby name node.

Maintaining and monitoring clusters. Loaded data into the cluster from dynamically generated files using Flume and from relational database management systems using Sqoop.

Hadoop Performance Tuning. Configure access control list (ACL). Configure SSH

Excellent understanding of Delegation token

Development Objectives:

To perform sample data analysis using Hadoop ecosystem.

Data will be imported into the Hadoop ecosystem from different sources like RDBMS databases,

Text files etc.

Roles and Responsibilities: -

Sqoop Data Import from RDBMS.

Import of text file data into HDFS and hive.

Data Analysis.

Analytical Reports.

Engineering Project: (B.E)

Name: Scaling of Archived E-Commerce Data Analysis through Hive

Skill Used: Hive, Sqoop, Cloudera Hadoop Distribution 5.7

Problem: Today E commerce companies are the one of the main sources of generating the large amount of the data and it produces mainly unstructured data. In order to handle such a huge unstructured data various techniques and technologies have been used. But the problem is that, there is the limitation of computational resources.

Solution Provided:

Move data to Hadoop ecosystem and Transform that data using hive and push final data to produce report to client.

CLUSTER SPECIFICATION:

Data Size: 1TB

Cluster Architecture: Fully Distributed

Package Used: CDH5.7

Cluster Capacity: 3.8 TB ~ 4TB approx.

No. of Nodes: 3 Data Nodes + 1 Masters + NFS Backup For NN

Roles and Responsibilities:

Cluster Planning and Architecture

Deploying CDH cluster

Analytics using Hive, Programming in HQL.

Diploma:

Name: Security System for System Admin

Skill used: Core Java

ACADEMIC ATTAINMENTS

SN

Exam

University/Board

Year of passing

Percentage

1

B.E (IT)

Pune University

2016

61.60%

2

Diploma (IT)

MSBTE

2012

67.19%

3

HSC

Maharashtra Board

2008

47.67%

4

SSC

Maharashtra Board

2006

64.80%

TECHNICAL SKILLS

Big Data: Hadoop, HDFS, Zookeeper, Hive, Pig, Sqoop, Oozie, Flume, MapReduce

Database: MongoDB, Cassandra, Oracle

Scripting: Shell Scripting

Languages: Java, C, C++

FIELDS OF INTEREST

Open to Learn new technologies.

Databases, Warehouse DB

Business Intelligence.

ADDITIONAL CERTIFICATIONS/ Achievements

Workshop on “Gridsim Toolkit” conducted by NBN SSOE at Pune in August 2013Participated in Vibration-2k9.

Winner of 2nd prize for "Animated Film Making Competition” at MIT, Pune in State level Technical Competitions TECHNICA-2012.

Participated in ‘SEED IT Idol Competition” organized by SEED InfoTech Ltd.

Presented paper on Digital Signature in the “Techno-Innova-2011” organized by BVJNIOT, Pune.

Participated in 'National Technical Quiz' at MIT, Pune in State level Technical Competitions TECHNICA-2011

HOBBIES

Playing outdoor games,

Cooking, and Listening to music

Travelling

PERSONAL DETAILS

Gender : Male

D.O.B. : 14th NOV 1990

Marital Status : Single

Address : 104 B Heramb Apartments, K.P.Nagar, Dhankawdi,

Pune-Satara Road, Pune-411043

Language Proficiency : English, Hindi, Marathi

DECLARATION

I hereby declare that the above written particulars are true to the best of my knowledge and belief.

Date:

Place: Mangesh S. Nila

Contact this candidate