hadoop administrator
Resume:
Sreenivasa Pandre E mail :
s *****.****@*****.***
Mobile : (301) 250
Hadoop Consultant
3042
P rofessional P rofile
Having 9+ years of Professional experience in IT Industry, involved in Developing,
I mplementing and maintenance of various CRM technology/Data Warehouse/ Big
data using such as Siebel CRM, BI Publisher, OBIEE 11g,Business Intelligence,
BODS, Big Data Ecosystems experience
Summa ry of Skills
Good working knowledge in Big data ecosystem related technologies
Experience in implementing Data Warehousing/ETL solutions for different
domains like financial, telecom,loyalty, Retail and insurance verticals
Hands on experience in installing, configuring Hadoop ecosystem
components like Hadoop MapReduce, HDFS, HBase, Oozie, H ive, Sqoop and
P ig
Assisted in designing, development and architecture of Hadoop eco system.
Good knowledge in programming Pig and Hive languages.
Expert in dealing with structured, semi-structured and unstructured data in
H adoop eco system.
Handled importing of data from various data sources, performed
t ransformations using Hive, Pig, loaded data into HDFS and HBase.
Assisted in tuning the performance of Hadoop eco system as well as
monitoring.
Assisted in Loaded data from various data sources into Hadoop HDFS/Hive
Tables
Expert in wri ting HiveQL queries and Pig Latin scripts.
Experience in providing support to data analyst in running Pig and H ive
queries.
Strong working knowledge of business intelligence tools like Business Objects
Experience in Data Warehousing and ETL processes
Experienced in job workflow scheduling and monitoring tools like Oozie and
Zookeeper.
Developed Pig Latin scripts to extract the data from the web server output
f iles to load into HDFS
1
Good Experienced managing Linux platform servers
Sound knowledge in install & configure Siebel 8.x on Solaris 10 on Sun
C luster.
Expert in installing and configuring Siebel on Sun One web server Extension
for Load balancing.
Good knowledge in Production Support, incident/change management,
service request management.
Good scripting knowledge in Bash shell scripting.
Have good experience, excellent communication and interpersonal skills
w hich contribute to timely completion of project deliverables well ahead of
schedule.
P rofessional Certification:
Oracle Siebel 8.0 consultant (Siebel CCC) certified from Oracle
Corporation
Education:
Master of Computer Science (M.Sc) from Sri Venkateswara University
Technical Skills:
Operating Systems : L inux (Redhat), Sun Solaris, AIX, Ubuntu and Ms-Windows
Languages : C, C++, Java, PL/SQL
CRM Package : Siebel 7.8, Siebel 8.x
RDBMS : O racle 10g /11, MySql, HBase
Big Data Ecosystem : Hadoop,MapReduce, HDFS, HBase, Zookeeper, Hive, Pig,
Sqoop, Oozie,
YARN,flume,impala,ganglia
Application Servers : Weblogic 11g, 12c, Tomcat 5.x and 6.x.
ETL Tool : Informatica 8.x and 9.x, BODS 4.0/4.1
Reporting tools : BI Publisher, BI launch Pad 4.1, Web In telligence, Crystal
Report
SCM Tools : Perforce, Team t rack,VSS, Harvest and HP Quality Centre
Methodology : A gile SDLC, U M L
Scripting language : Bash, Perl, Pig
Protocols : T CP/IP, SNMP
Employment history:
Walgreens Co. Chicago, I L,USA (Aug 2012 - Till
Date)
2
H adoop Developer / Administrator
H adoop – DA is a big data platform designed to analyze the business intelligence
reports using payroll & marketing data. As part of this project our goal is to move all
t he current CRM data to hadoop and to convert the existing BI reports by pointing
t hem to hadoop from the t raditional ETL of BI system
Responsibilities:
• Installation and configuration, Hadoop Cluster and Maintenance, Cluster
M onitoring and Troubleshooting and Transform data from RDBMS to HDFS
• Handled importing of data from various data sources, performed
t ransformations using Hive, MapReduce, loaded data into HDFS and
E xtracted the data from MySQL into HDFS using Sqoop
• Performed data completeness, correctness, data t ransformation and data
quality testing using SQL
• Exported the analysed data to the relational databases using Sqoop for
v isualization and to generate reports for the BI team
• Experience in providing support to data analyst in running Pig and H ive
queries.
• Managing and reviewing Hadoop log files
• Creating H ive tables, loading with data and wr iting hive queries which will
r un internally in map reduce way
• Installing and configuring Hive and also wri t ten Hive UDFs
experience in large scale data processing, on an Amazon EMR cluster
•
• Efficient to handled Hadoop admin and user command for administration.
• Supported technical team members for automation, installation and
configuration tasks.
• Wrote shell scripts to monitor the health check of Hadoop daemon services
and respond accordingly to any warning or failure conditions
• Involved in creating Hive tables, loading with data and wri ting hive queries
w hich will
• Run internally in map reduce way.
Environment: H adoop,MapReduce,Hive,Pig,Oozie,Hbase,Sqoop,Flume, Java, SQL,
Eclipse, Unix Script, BO,YARN and Ganglia
Capgemini U.S,Chicago, I L,USA (Jan 2012 –
J uly 2012)
Hadoop Developer / Administrator
The MCBS is the acronym of MasterCard consolidated billing system. I t is the
p rocess of collecting the crucial vital data from various systems of MasterCard and
consolidates them and creates the bills and invoice for various customer of the
3
M asterCard. This process determines what MasterCard will bill i ts members for
specific events.
Responsibilities:
1
• Identified the best solutions/ Proof of Concept leveraging Big Data &
A dvanced Analytics levers that meet and exceed the customer's business,
f unctional and technical requirements.
• Strong working experience with open source technology
• Store unstructured data in semi structure on HDFS using HBase
• Used Change management and Incident management process following the
company standards
• Implemented parti tioning, dynamic parti tions and buckets in H IVE
• Continuous monitoring and managing the Hadoop cluster through Cloudera
M anager
• Demonstration of the Live Proof Of Concept Demo to Clients
• Supported technical team members in management and review of Hadoop log
f iles and data backups.
• Suggested improvement processes for all process automation scripts and
t asks.
Environment: H adoop 1.2.1, Map Reduce, Hive 0.10.0, Pig 0.11.1, Oozie 3.3.0,
H base 0.94.11,
Sqoop 1.4.4, Flume 1.4.0, Java, SQL, PL/SQL, Oracle 10g, Eclipse,
U N IX Script
Fa rmers I nsurance group, LosAngeles, CA ( Dec
2010 – Dec 2011)
Siebel Administrator
The Farmers Insurance Group of Companies is a personal lines p roperty and
casualty insurance g roup providing homeowners insurance, auto insurance, life
i nsurance, Medical Insurance and financial services in the United States. A
subsidiary of Zurich Financial Services, Exchange, I t i s locally headquartered in Los
A ngeles, California, with about $6.5 billion in annual revenue, provides property,
casualty and commercial insurance in the United States
Responsibilities:
• Prepared test packs, release notes, deployment checklists
4
• Maintaining all Development, Test, Preproduction & Production
environments
• Setting up local developer environment for developers
• Maintaining Siebel Server Components & Parameters
• Administration of Enterprise, Server task and component task
• Deployed the new releases in different Environments
• Remote Administration – Managing & monitoring all the Remote
components.
• Prepared deployment plans for major upgrade releases
• Used Application Deployment Manager (ADM) for Migration
• Attending the P1/P2 calls to resolve the issues
• Analysis of Log /FDR/Crash files to t rouble shoot and fix the issues
• Administration of BI Reports and Trouble Shooting in case of any issues
Environment : S iebel 8.1, Oracle, AIX, Ha rvest, OBIEE
Ampersand Da r win-F idelity, Mexico (Feb 2010 - Dec
2010)
IT Consultant
A mpersand is a Mexican company owned Posadas Grupo who specializes in the
design, development, implementation and operation of loyalty solutions, same
generating business results and high ROI for its clients. Grupo Posadas was named
t he "Best Hotel Chain in Mexico" by World Travel Award.
R esponsibilities:
• Perform Siebel upgrades, patch installation
• Maintaining all Development, Test, Preproduction & Production
environments
• Setting up local developer environment for developers
• Maintaining Siebel Server Components & Parameters
• Analyzing and resolving the Production Incidents [tickets] adhering to SLA’s.
• Prepared deployment plans for major upgrade releases
• Analysis of Log /FDR/Crash files to t rouble shoot and fix the issues
• Monitoring components, Server utilizations and Troubleshooting issues as
Server
• Coordinating with the team to solve issues
• Documentation of Deployment & major release
E nvironment : S iebel 8.1, Oracle, L inux
LA N Chile Loyalty I mplementation for LA N Airlines (Sep 2009 -
Feb 2010)
IT Consultant
5
T his Project is being executed for LAN Chile an Airline consortium in Chile.
I t involves providing Oracle Chile Support for assisting their end-to-end
i mplementation of Siebel loyalty application in LAN Chile. This
I mplementation will help LAN Airlines to maintain and strengthen its
competitive position by making effective use of various distribution
channels and by further strengthening customer service.
R esponsibilities:
• Performance tuning of the application
• Compilation of the srf in both English and Spanish
• Responsible for Migrating of Repository
• Involved in preparation of the UAT and SIT plan
• Siebel Installations, Upgrades, Applying patches & Repository M igrations
• Health checking the Production servers
• Siebel Application Administration tasks such as setting up Divisions, user
positions, responsibilities, Pre-defined queries and other application
administration jobs
• Troubleshooting server issues and downtimes
Environment : S iebel 8.1, Oracle, Linux
B ritish Telecom (BT-02 ) (Feb 2006
- Sep 2009)
Technical Associate
A C MM 5 Level company worked in IT and Telecom domain with major client
as BT
Involve in regular deployments i.e., Siebel Repository Migration, Also work on day to
day ad hoc requests and involve in incremental compilation jobs Involving in the Go
L ive deployments on Production and testing environment as support for release
u pgrade and migration, administrations tasks on production,Siebel enterprise
i nstallation and Siebel New Patch releases
Responsibilities:
• Responsibilities undertaken as Siebel Server Administration
• Installation and configuration of Siebel (7.7 and 7.8) gateway, Siebel
A pplication server
• Installation and configuration of third party products
6
• Repository Export / Import, SRF Compilation, Schema Changes, Deployment
of Repository, SRF Replacement, t ransfer M id t ier files, Quicksync
deployment on Test environments, Manual tasks like Deploying release notes
• Non-Repository Migrations to various testing environments and
t roubleshooting M igration Issues
• Setup & Maintenance of offshore Developers data (Data Extracts &
synchronisation)
• User Creation at Application and Database Level
• Co-ordination with various teams (Development, Testing, Design,
a rchitecture) for resolving Siebel related Issues
Environment : Siebel7.8, UN IX Solaris Servers, Windows 2000, Oracle10g
Linux V6, WYSE (Feb 2005 - Nov 2005)
Software Engineering
Thin clients are the answers for the modern day requirement of running highly
secure, less maintenance oriented and highly reliable networks for organizations. A
T hin client network is a server based network where the majority, if not all, of the
p rocessing is done on the server rather than by the individual client machines . The
W YSE Linux system is designed on the add-on technology wherein each installation
can be customized based on the customers requirement. Add-ons like the Java, ICA
etc.
Responsibilities:
• Involved in maintenance / enhancement of the Wyse Linux V6.
• Have worked on tailoring the Linux to suit the hardware requirements of
Wyse thin Clients
• Involved in BUG fixing and improvement of the overall Linux Product.
• Fixed problems arising due to the window manager issues. (qvwm window
m anager)
• Working experience with SCM tool – Perforce and Bug Tracking tool –
Teamtrack
Environment: Linux,GTK,C++,Java,GNU C Compiler
7
Contact this candidate