Sign in

Manager Hadoop

New Delhi, Delhi, India
October 28, 2018

Contact this candidate


Rakesh Dubey Email id:

Ph:874-***-**** Address : E140,1st Floor, Sector 15


Professional Summary

An astute and result oriented Master of Computer Application (MCA) professional within 7 years of experience. Proficient in coordinating and administrating matters related with different kind of Hadoop, Hive, Hue,Pig,Hbase,Flume,Oozie and Data Warehousing. MySQL database solution for data centralization, Gathering Business Requirements, Data Management & Data Integration. Flexible in writing, testing and implementing Stored Procedures. Utilize keen analysis, insights, and team approach to drive organizational improvements and implementation of best practices. Well versed with efficiently handling all activities and maintaining Quality.


Planning, implementing and maintaining Hadoop Cluster using Cloudera Manager 5.6.

Installing and maintaining Hive,Spark,Kafka,flume along with Cloudera Manager.

Optimizing Hadoop by managing memory for different tools in ecosystem.

Proficient in Memory management (JVM, Heap, YARN ).

Cluster health monitoring and troubleshooting using Cloudera Manager.

Commissioning and Decommissioning nodes to an existing Hadoop cluster using CDH 5.6

Involved in bench marking Hadoop/Hbase cluster file systems various batch jobs and workloads.

Good in analyzing log files for Hadoop and ecosystem services and finding root cause.

Verify HDFS data storage and running map-reduce jobs.

Experience in importing and exporting the data using Sqoop to HDFS to Relational Database systems/mainframe and vice-versa.

Good in scheduling Hadoop/Hive/Sqoop/Hbase jobs using Oozie.

Verify Installed and configured Flume, Hive, Pig, Sqoop,Hbase and Oozie on the hadoop cluster.

Good in writing Linux Shell Scripting for deployments and configuration.

Good understanding of Database and Data warehouse concept.

Possesses good knowledge on Installing & Configuring O/S like Windows, Linux.

Basic knowledge of shell scripting in Linux.

Job scheduling using crontab in Linux.

Good in interaction with product team, business analyst team for product gathering

Good in coordination with development team for resolution of bugs

Preparation of test results as per the test execution results

Technical Skills



Operating Systems

Window 7,Ubuntu 14.04,Ubuntu 16.04

Cloudera Manager

Cloudera Manager 5.6

Web Services


Database Tool

MySqlYog,Mysql 5.6


Shell Script


Internet/Ecommerce ( Paytm Recharge, Oauth, Wallet, Paytm Mobile App, Mobile Portal,Paytm Wallet,QuikWallet, Supplified,MPOS(Mobile point of sale.

Dupax Technologies Pvt Ltd May 2018-Still Working

Project: MPOS (Mobile point of sale) Machine and Support Hadoop Cluster on the client side

Technologies: Cloudera Hadoop 5.6, Hive, Pig, Hbase, Scoop,Kafka,Flume,Oozie,Impala

Role: Hadoop Admin Lead,Installation & Troubleshooting,L3 Support

Synopsis: To create and deliver innovations that will empower each and every individual to handle money in a simple, safe and convenient manner at your door stop. To become the largest,most trusted payment solutions company by opening up a world of unlimited possibilities for all our customers and stakeholders.Dupax that simplify payment acceptance, while creating business opportunities for Issuers, merchants and brands to connect with consumers.

Responsibilities in hadoop: Verify in Hadoop installation, configuration, managing Hadoop Clusters using Cloudera Manager. Provide L3 support and verify backup configuration and recovery from a Namenode failure. Verify Installation of various Hadoop Ecosystems and Hadoop Daemons. Monitoring system health using Cloudera Manager. Analyzing log files for finding root cause of the issue. Sound experience with wide range of big data components such as HDFS, Map Reduce, Sqoop, Flume, Pig, Hive, Hbase installations and troubleshooting etc.

Commissioning and Decommissioning of nodes as require,good working knowledge in Hadoop security like Kerberos and Sentry.Troubleshooting Hadoop cluster runtime errors and ensuring that they do not occur again.Evaluation of Hadoop infrastructure requirements and design/deploy solutions.Backup and recovery task by Creating Snapshots Policies, Backup Schedules and recovery from node failure.Moving data from one cluster to another.

Makeupguru April 2017 - Jan 2018

Professional Experience

Co-Founder and working freelancer as Hadoop Admin & Provide L3 Support

Project: Online Marketplace Portal for beauty products

Technologies: PHP, Mysql

Synopsis: As a product owner, I analyzes market and competitive conditions and lays out a product vision that is differentiated and delivers unique value based on customer demands. The role of the product owner as “to discover a product that is valuable, usable and feasible”. Makeupguru is the online and offline which marketplace fullfill the gap between north india makeup market. Makeupguru is dedicated portal to deliver a very reasonable price beauty and wellness products for everyone.Portal cover all Mans salon and beauty parlor to deliver beauty and wellness products. People either man or woman or girls book online beauty parlor for makeup without hassal free waiting time at their own location, convenience time at best price. Company also create platform for individual woman/girl have beauty parlor knowledge,can create their profile on portal and start career as a makeup artist.

Supplified Technology Pvt Ltd( Omaxe Group) Nov 2015-Feb 2017


Technologies: Cloudera Hadoop 5.6, Hive, Pig, Hbase, Scoop,Kafka,Flume,Oozie,Impala

Role:Hadoop Administrator Lead (Installation & Troubleshooting,L3 Support)

Synopsis: is online shopping store creating an ecosystem that is favorable for buyers and sellers in changing the way people deal in construction material. Supplied is the largest online portal for supply of the widest range of essential products for businesses, factories, offices and labs in India and to be a single-stop solution for all your commercial product requirements related to construction.

Responsibilities in hadoop: Verify in Hadoop installation, configuration, managing Hadoop Clusters using Cloudera Manager. Verify backup configuration and recovery from a name node failure. Verify Installation of various Hadoop Ecosystems and Hadoop Daemons. Monitoring system health using Cloudera Manager. Analyzing log files for finding root cause of the issue.

Livquik Pvt Ltd Feb 2015-May 2015

Project : QuikWallet (Pay the bill from your cellphone & Utility (Recharge, DTH & Data Card) )

Technologies: Apache Hadoop,Cloudera Hadoop 5.6, Hive, Pig, Hbase, Scoop,Kafka,Flume,Oozie,Impala

Role: Installation, supporting & troubleshooting

Synopsis : Quikwallet is a platform focused on enabling payments online & offline for merchants(Restaurant) and consumers. Quikwallet that lets you pay the bill from your cellphone no cash or card needed. The bill is delivered to your mobile phone and you pay by simply using the app where you can securely store your credit and debit cards.

Responsibilities: Verify in Hadoop installation, configuration, managing Hadoop Clusters using Cloudera Manager.Verify backup configuration and recovery from a name node failure. Verify Installation of various Hadoop Ecosystems and Hadoop Daemons. Monitoring system health using Cloudera Manager. Analyzing log files for finding root cause of the issue.

One97 Communication Pvt Ltd ( Paytm Payment Bank Ltd ) May 2011-Jan 2015

Hadoop In Paytm:( Cloudera Manager,Hive,Hbase,Pig,Scoop,Flume,Kafka,Oozie)

Technologies: Cloudera Hadoop 5.6, Hive, Pig, Hbase, Scoop,Kafka,Flume,Oozie,Impala

Role: Installation, Supporting & Troubleshooting

Description: Paytm deal in 3 segment like wallet, marketplace, recharge, wallet has large data sets in their historical database(tables).The data related to the unmatched record and a transactional system are store here. Space issues and costs for maintaining the same has been increasing and due to which system had to be develop on a Bigdata platform. It processes the request made from different web applications and retrieve data which are stored in Hadoop cluster. The module helps to retrieve the data faster using Hadoop and related technologies.

Paytm Marketplace and Recharge (Web and Mobile-WAP/App) and Marketplace App

Technologies: Java,Spring,Html,HTML5,CSS3, MYSQL 5.0.51a,DNSMasq

Testing Tools: Manual Testing, Performance Testing (Jmeter),MITE (Mobile Internet Testing Environment) and ADT Eclipse, Automator & UI Automation.

Synopsis : User can recharge own Mobile/DTH/Toll or Data Cards/Electric bill payments for all operators: Airtel, Vodafone, Reliance, Idea, BSNL, Uninor,Tata Indicom, Aircel, Tata Docomo, Loop Mobile, MTS, STel,Videocon and booked bus tickets and pay through net banking/credit,ATM or debit cards/IMPS.


Paytm market place is online shopping app with a revolutionary concept to bargain for a deal before you buy. With an eye to change the game in mobile commerce in India, the app features shopping in various categories including Men, Women, Kids fashion and Home furnishing etc. you can add cash on your wallet from your bank / credit card and shop much faster on the mobile phone. Users can get cash back or refund from a merchant in Paytm Cash Wallet and use it across every item sold in the marketplace.

Paytm Oauth and Wallet :-

Oauth: Paytm oauth is used for authentication and authorization of end user. Oauth installed on web server and client-side applications. Client application requests an access token from the paytm Authorization Server, extracts a token from the response, and sends the token to the paytm oauth API that you want to access.

Wallet: Paytm has come up with a simple, secure and easy way for your online transactions by introduction of the incredible Paytm Wallet. Paytm Wallet allows you to spend your money online in a very safe way on different sites(merchants). Actually Paytm Wallet is a just like any normal bank, it's just that this one exist only online. Paytm wallet adheres to all the set of rules and regulations provided by RBI. Paytm wallet helps you with fast and hassle free transactions which also gives user amazing rewards in terms of cash back and exclusive deals .It saves you from online frauds and lethargic bank responses in your online transactions.Paytm wallet is crafted in such a way that different merchants can integrate it, in their PG module hassle free. In addition, increase their user base.


Create test cases, execute them as per PRD/SRS (product request development/Software Requirement Specification), validate the test cases, and report the results using bug-reporting tool Phabricator. Promo codes testing to check functionality of app on different OS like s(IOS and Android).Functional Testing (Smoke, Integration, System and Regression Testing ) of Merchant Panel or Payment Gateway.Load testing via Web load UI and JMeter as well.Hands on of WAP Portal or Apps testing on real devices OS (J2ME, Android, Windows, IOS and Blackberry) and emulators as well.

JR Beeta-Soft Technology Pvt Ltd March 2009-April 2011

Project : Payroll

Environment: Php, Mysql

Testing Tool: Manual Testing,Performance Testing using tool Jmeter

Test management Tool: Redmine

Description: Enterprise Payroll is a complete ERP system designed specifically for small to medium sized organizations. Payroll simplifies back-office process automation for mid-sized and growing business. It provides real-time information about Employee Management, Attendance Management, Leave Management, Loan Management, Reimbursement Management, Define own salary grade, Salary Management, income Tax Management, TDS Calculator, HRA/PF/ESI Calculator, Gratuity calculator, Individual Staff Login Facility, Reports like new joining report, Absent summary report, HR report, Employee category report, Monthly salary report, Salary payment register, Salary transfer register, Salary transfer letter, Email payslip, Department wise salary report.

Professional Qualification

Passed M.C.A in year 2008 from S.R.M.S College of Engineering and Technology, Bareilly (U.P) affiliated to U.P. Technical University Lucknow.

Educational Qualification

Matriculation passed from S.V Inter College Bareilly, U.P. Board.

Intermediate passed from Government Inter College Bareilly, U.P. Board.

Graduation (B.Sc) passed from Bareilly College, Bareilly, affiliated with M.J.P Rohilkhand University, Bareilly.

Contact this candidate