Hadoop developer
Resume:
*******.******@*****.*** (1-302-***-****
AJITESH GAUTAM
Experience
Ajitesh has a total of around 7 years of IT experience with specialization and expertise in Big data, Data Warehousing and Business Intelligence area. He has around 3 years of experience in Big data technologies. Worked on all phases of software development lifecycle, from gathering requirements to data modeling, design, implementation, testing and support.
Currently working as Lead consultant in Hadoop delivery team at Allstate Insurance in Pune, designing and developing big data application.
Extensive experience in loading and analyzing large datasets with hadoop framework (Map Reduce, HDFS, PIG and HIVE,Flume,Sqoop,SPARK,Impala),No Sql databases like Mongodb.
Extensive experience of handling and converting various data interchange formats (XML, JSON, AVRO,PARQUET) in distributed framework.
Experience of developing different utilities for JSON data format- JSON Validator/JSON data generator and JSIVE.
Technical expertise in Java,Hadoop, Hbase, MongoDB,Map Reduce, Pig,HIVE,Sqoop, Flume,Oozie, Informatica Power center 9.1/8.6,B2B DT,Unix shell scripting.
Experienced in integrating various data sources like Oracle, Netezza, WebsphereMQ, Xls files, Fixed Width delimited Flat Files & XML Files through Informatica and B2B DT.
Experienced in interacting with Business users in analyzing the Business process requirements and transforming them into documents, designing, and rolling out the deliverables.
Project Details
EMPLOYER – Allstate InsurancE (From April’15– Present)
Currently working as lead consultant in Big data analytics delivery team at Allstate insurance in Pune, designing and developing big data application.
Client:: ALLSTATE USA.
As part of Hadoop team, we are working on building MDM on Hadoop. This requires multiple data sources to be setup and processed in real-time and batch mode as per their data classifications. To fulfill these requirements multiple projects are running in parallel and I have been working as an architect for these projects.
ROLE:
Involved in project design and creation of technical specifications.
Written Map reduces processes to convert XML files (data size around 2TB) into JSON format. This includes evaluation of various libraries JSON-LIB,JSON-ORG,Apache camel and dynamic JAXB.
Developing the enterprise search capability by transferring transformed data to Solr cloud.
Written Map reduce processes to convert JSON format into AVRO.
Created Hive and Impala tables to store the processed results in a tabular format.
Involved in bringing source data from accounting systems to hdfs with the help of flume and kafka.
Involved in creating oozie and Control-M workflows to automate data transformation and presentation processes.
Verifying feasibility of KAFKA and SPARK combination.
Participating in deployment, system testing, UAT.
Project Details
EMPLOYER – Fidelity, GURGAON/Bangalore(From JAN’12– Mar’15)
Worked as a senior Bigdata developer in web product research team at Fidelity in Gurgaon /Bangalore, designing and developing big data application.
PROJECT – EDM ENHANCEMENTS (June‘14–Mar’15)
Client:: FIL UK
Environment: PIG, HIVE, FLUME, OOZIE, INFORMATICA BIGDATA Edition, Unix scripting, CORE JAVA, ORACLE 11g.
The purpose of the project is to enhance capabilities of enterprise data mart by feeding the customer’s regulatory status as per different geographies in the EU. The solution is based on the open source hadoop stack. The data will be stored in Hadoop file system and processed using Map Reduce jobs, which intern includes getting the raw data, process the data to obtain controls and redesign/change history information, extract various reports out of the controls history and Export the information for further processing.
ROLE:
Involved in project design and creation of technical specifications.
Written Map reduce processes to process the huge input file.
Written the Apache PIG scripts to process the HDFS data.
Created Hive tables to store the processed results in a tabular format.
Involved in bringing source data from accounting system to hdfs with the help of flume.
Involved in creating oozie workflow to automate data transformation and presentation processes.
Setting up Informatica power exchange for hadoop to take the data from HDFS.
Participated in deployment, system testing, UAT.
Prepared implementation plans for moving a code to production.
PROJECT – SOLR SEARCH IMPLEMENTATION (PDF Documents) (Feb‘14–May’14)
Client:: FIL UK
Environment: SOLR, JAVA, Apache TIKA.
The purpose of this project was to decommission existing database related search capability and build SOLR search on large pdf documents having fund related information. Apache TIKA was used for text extraction and SOLRJ for document indexing into SOLR.
ROLE:
Involved in project design and creation of technical specifications.
Written solr indexing process by using SOLRJ API and APACHE TIKA.
Participated in deployment, system testing, UAT.
Prepared implementation plans for moving a code to production.
PROJECT – Sentiment Analysis-Twitter Data (Aug ‘13 –Jan’14)
Client:: FIL UK
Environment: HIVE, FLUME, OOZIE, UNIX, Micro Strategy and CORE JAVA.
Purpose of this project was to build capability to collect and analyze twitter data for reading the public sentiments related to FIL/FMR and its competitor’s products. As a result of this product Fund managers can make targeted, real-time, decisions that increase market share.
ROLE:
Involved in project design and creation of technical specifications.
Setup and configure flume for connecting and gathering twitter data.
Created Hive tables to store the processed results in a tabular format.
Configuring Micro Strategy to connect with HIVE and developing reports with microstratgey.
Participated in deployment, system testing, UAT.
PROJECT – CFDR RECONCILIAITON AND REPORITNG (JAN ‘12 –July‘13)
Client:: FIL UK
Environment: PIG, HIVE, FLUME, OOZIE,INFORMATICA BIGDATA Edition,HP-Unix, CORE JAVA.
The purpose of the project is to store global fund accounting data for reporting and reconciliation purpose. The solution is based on the open source framework Hadoop. The raw source data will be stored in Hadoop file system and processed using PIG. The processed data was further consumed by Informatica and HIVE for reporting and reconciliation purpose.
ROLE:
Involved in project design and creation of technical specifications.
Written the Apache PIG scripts to process the HDFS data.
Created Hive tables to store the processed results in a tabular format.
Involved in bringing source data from accounting system to hdfs with the help of flume.
Involved in creating oozie workflow to automate data transformation and presentation processes.
Setting up Informatica power exchange for hadoop to take the data from HDFS.
Participated in deployment, system testing, UAT.
Prepared implementation plans for moving a code to production.
EMPLOYER – TCS, NOIDA/ GURGAON (From JUL’08– DEC’11)
Worked as Data warehousing developer and designer with migration and POC on BIGDATA related products.
PROJECT –MEcars.Com(Apr ‘11 –DEC‘11)
Client:: Eli Lilly and Company
Environment: HP-Unix, JAVA, MYSQL, OBIEEE, MONGO DB.
Medicaid and CARS process settlement website was initially using Oracle as backend storage. Seeing the data volume and poor website performance decision was taken to migrate it to Mongodb which was the latest and most popular no sql db at that time.
ROLE:
Responsible for impact analysis and system design for migration.
Developed the migration scripts for Oracle to MongoDB deployment.
Responsible for end to end testing of the functionalities while migration.
PROJECT – B2B MEDICAID(Apr ‘10 –MAR‘11)
Client:: Eli Lilly and Company
Environment: HP-Unix, JAVA, Informatica Power Center, ORACLE, OBIEE.
Medicaid is developed to receive Contract, Rebate, Chargeback, Product and Customer information from other Business Systems and Applications on a daily basis. Data contains the same information as CARS but with a difference of government agencies. This data is then processed and sent to a downstream application “Reporter “for generating the business report for the purpose of analysis and decision making. An ETL process was setup to extract the data from various sources, apply business validations before storing it into Medicaid database and push it to Reporter database (Down stream application).Reporting was done with OBIEE.
ROLE:
Client Interaction
Responsible for understanding the functional requirements of the client.
Contributing to the solution as an ETL Developer.
Creation of Unit Test Cases and Test Scripts.
Testing of the functionalities
Engaged in warranty support.
Written generic java code for creating and sending reports in excel format.
PROJECT – B2B CARS(Apr ‘09–MAR‘10)
Client:: Eli Lilly and Company
Environment: HP-Unix, JAVA, Informatica Power Center, ORACLE, OBIEE.
It is a development project. CARS is developed to receive Contract, Rebate, Chargeback, Product and Customer information from other Business Systems and Applications on a daily basis. This data is then processed and sent to a downstream application “Reporter “for generating the business report for the purpose of analysis and decision making. An ETL process was setup to extract the data from various sources, apply business validations before storing it into CARS database and push it to Reporter database (Down stream application).
ROLE:
Client Interaction
Responsible for understanding the functional requirements of the client.
Contributing to the solution as an ETL Developer.
Creation of Unit Test Cases and Test Scripts.
Testing of the functionalities
Engaged in warranty support.
Written generic java code for creating and sending reports in excel format.
PROJECT – B2B CARS (AUG‘08–MAR‘09)
Client:: Eli Lilly and Company
Environment: HP-Unix, Informatica Power Center, ORACLE, OBIEE.
As a part of this project client’s sales reporting capabilities were developed. Data from various source systems was integrated into staging environment. On top of that reporting was done with OBIEEE.
ROLE:
Responsible for understanding the functional requirements of the client.
Contributing to the solution as an ETL Developer.
Creation of Unit Test Cases and Test Scripts.
Testing of the functionalities
Education
First division Bachelor of Technology (B. Tech) from Institute of Engineering and Technology, Lucknow, India, (2004-08)
Summary
Big Data
Java,Hadoop, Hbase, MongoDB,Map Reduce, Pig,HIVE,Sqoop, Flume,Oozie,Impala
Data warehousing Tools
Informatica Power center 9.1/8.6,B2B DT,SSAS,SSRS,BO,OBIEEE
Databases
Oracle 11g,Neteeza
Programming
Sql,Pl/sql,Linux shell scripting
Tools
Toad,PL/Sql developer, Remedy ARS,HP QC,Control-m,WA,JIRA,Confluence
Operating Systems
Windows XP 2003/07/10,Linux
Version Control
VSS,Clearcase
Functional Areas
Health Care,Finance, MIS, Investment Banking, Intellectual Property, Conversion and Maintenance.
Search
Solr,Cloudera search
Contact this candidate