About me

I am a nocturnal Developer building innovative products and solutions, quick learner, and a good team player. I have collected an array list of technical skills in my bag of tricks.

Professional Summary

Development Engineer with 3+ year of experience in product development in HADOOP from scratch.

From September 2014 to Till Date Hadoop Developer in Snapdeal.com

Fab 2012 to September 2014 AS Hadoop Engineer in InfoTrellis Pvt Ltd.

Academic Profile

S. No

College

Course

Year

1

University Grant Commission India

UGC- NET

2012

2

Department Of Computer Science, University Of Delhi, New Delhi

Master of Computer Application (MCA)

2012

3

Jiwaji University Gwalior (M.P.)

Bachelor of Computer Application (BCA)

2009

4

M.S.V inter collage Kalpi (U.P.)

Intermediate (12th)

2006

5

MahaVeer collage Neem Gaon (U.P.)

Higher Secondary (10th)

2004

Technical Proficiency

Operating System

LINUX,UNIX, Windows

Development Editor

Eclipse, Netbeans

Programming Languages

JAVA(Expert), C(Proficient), C++(Proficient) and Unix Shell scripting

Technologies

Hadoop(HDFS,MR1, Sqoop, Oozie, Hive, Pig Latin, Flume, Hbase, Mini Cluster etc.), Spring Framework, JSON APIs(Gson/Jackson),Log4j, Apache CXF REST services, Twitter4j, RestFB (Facebook API), Lucene search api,

Web Technology

Apache Tomcat server,

Database

MySQL, H2, Titan Graph DB, Vertica, Mongo DB, Tungsten,

Others

Design Patterns, Data Structure, Networking, Operating System

Key Project Details

Snapdeal Replication Engine ™ -

Framework is does replication of data from different data sources. It Design in such a way it move data from source to sink in incremental load fashion and Framework is plug-able enough to accept new source and sink Vertica, MySQL, mongo, HBase, HDFS etc.

Responsibilities –

Fully responsible for End to End design and development of framework.

It is in production and doing replication about 30 databases and 1600 table with huge data from Vertica/ MySQL to HDFS in 3 time in day. Destination data size about 3 TB.

Snapdeal Log Processing Engine ™ -

I innovated this module, It process server log offline using Hadoop components and extract fact about users and product which is proving positive to the business.

InfoTrellis AllSight™ -

A Big Data product built using Hadoop technology like MapReduce 1, Hadoop, HBase, Hive, Oozie, Sqoop and Pig, to provide a platform for big data analytics and also includes a set of big data solutions built on top of it.

Responsibilities –

Developed “Social Media Master” Framework is core framework in “AllSight” to extract hidden customer information in social media data like twitter and Facebook on top of (oozie,pig,hdfs,H2)

Originated “Social Media Toolkit” to collect Facebook feed on top of Hbase, H2 database.

Worked on developing Twitter and Facebook data collection jobs for “Social-Media-Master (SMM)” module. SMM is implemented in java and invoked through pig UDF for collecting Facebook, Twitter data. The collected data is then transformed into JSON format. Hbase and RDBMS (MySQL/H2) used for Data storage.

Formulated a unique extractor pluggable feature in SMM Framework to allow users to plug in required Extractor among the set of OOTB SMM extractors.

Developed major SMM Extractors like Keyword extractor, User Profile extractor, User Location extractor and Relevance, Sentiment extractor using various self-evolved algorithms.

Created UNIX shell script “AllSight Installer” for installing AllSight in Production environment. The basic duty of the installer is to,

Install component in local and HDFS file system

Creation of database, tables, indexes in MySQL

Deploy war files in tomcat

Prepare dynamic launcher for launching job

Dynamic uninstaller for AllSight Uninstallation

Developed “REST Services” using java, HBase, MySQL, Spring JDBC on top of Apache CXF framework and tomcat server. These rest services are utilized by “AllSight Big Data Solutions”.

Hands on experience implementing Machine learning for Sentiment Classifier module. This classified used to find out whether a sentence is conveying positive or negative sentiment.

Developed Data Aggregator and Loader framework that aggregates data stored in HDFS using HIVE loads the aggregated data using Sqoop.

Worked on Transformers Engine which transforms data from other format to AllSight Compatible.

Played a vital role in fine tuning the Performance of various modules of AllSight.

Played with various “Design Pattern” and software development strategies.

InfoTrellis Veriscope™

Reporting software for IBM Master Data Management (MDM)

Responsibilities -

Developed Installer in UNIX Shell script for automated Veriscope installation

Performance Analyzer Tool

Responsibilities –

It is used for analyzing overall performance of any application running on UNIX. It collects data about the resources like memory, CPU, I/O, virtual memory performance etc., and for a given application processes id generates a graph using the collected data.

XML Generator

Java Software to design XML template that can be consumed by other software like MDM.

Designing of new layout of XML

Generate multiple XML using template XML take value data from CSV or database

Employee Timesheet Software

This software is being used by InfoTrellis Internal Employee

Awards and Achievements

Awarded as Best Performer of the Year 2012 & 2013 in InfoTrellis Pvt Ltd

Cracked UGC-NET(Computer Application) June 2012 in very first attempt

Shortlisted as Junior System Administrator in Indian Institute of Science Bangalore (IISC)

Won 1st prize in Technofelia for Java Development in JNU Tech festival

Won 2nd prize in NERDZ 2010 for Java Development in Jamia Hamdard University tech festival

Worked on setting up network in the Department computer lab at Jiwaji University in BCA 2008

Single-handedly assembled computer lab for Sankalan technical festival Delhi University in MCA 2011

Personal Profile

Father Name : Kamlesh Kumar Pranami

Date of Birth : 1st July 1991

Languages Known : English, Hindi

Hobbies : Swimming, video games, cooking, driving, bike riding

Contact this candidate