Post Job Free
Sign in

Project Data

Location:
Sunnyvale, CA
Posted:
September 15, 2017

Contact this candidate

Resume:

Karthikeyan Rasipalayam Durairaj

+1-414-***-**** *************@*****.***

Experience Summary

Around 8+ years of IT experience in Data warehousing, Bigdata, Mainframe and RDBMS in design, development, testing, implementation and support of enterprise data warehouse. Experienced in Requirement Analysis, Test Design, Test Preparation, Test Execution, Defect Management, and Management Reporting.

Bigdata Testing Experience:

Hortonworks Certified Developer (HDPCD) by Hortonworks.

Extensively worked on Hadoop Ecosystems testing like HDFS, HIVE, PIG, SQOOP,JAVA and successfully deployed Enterprise Search, Real time data Testing, Data Lake projects.

Automated JSON Parsing, XML file paring using domp parser in Java Environment.

Experience in Big Data ingestion tools like Sqoop, Flume, HDFS commends.

Automated JSON Parsing, XML file paring using domp parser in Java Environment.

Good knowledge in Apache Storm and Hands on Testing Experience in streaming data into Elastic Search.

Experience in testing Middleware - SOA, Rest API & Integration testing.

Experience in Project Lead and Management activities, Involved in Requirements study and Analysis, Test Plan/Design/Metrics, UAT Support

Hands on Testing experience in Enterprise Level Data Lake in Hadoop Platform for various data sources like Oracle, SQL Server, DB2, AS400 and Mainframe VSAM file etc.

Testing Design for Data Lake for the Enterprise using Apache Hadoop and it's Ecosystems

Design and Architect the Enterprise Level Hadoop solutions for Various Use Cases

Experience in REST API testing using message queues IBM Websphere MQ, JMETER, SoapUI, Elasticsearch and any supporting tool.

ETL/Data Testing Experience:

Understanding the Business requirement document (BRD) and Data mapping document (DMD) completely and implements testing methodologies.

Experience in writing complex SQL to examine sample record sets for consistency, data corruption and over all data quality

Preparing the test case in QC and managing the related activities

Extensive testing ETL experience using Informatica 9.1/9.6 (Power Center/ Power Exchange) (Designer, Workflow Manager, Workflow Monitor).

Experienced in dealing with clients to gather requirements, understanding the Business requirements, product demonstrations and providing product support.

Extensively used ETL methodology for supporting data extraction, transformations and loading processing in a corporate-wide-ETL Solution.

Hands on experience with analysis of business, technical, and functional requirements and Developed, Executed test plans, test cases and test strategies.

Experience with software change management tool Rational Clear Case for versioning the documents and maintaining the document repository.

Mainframe Development Experience:

Sr. IBM Mainframe Application developer, hands on experience in application development. Extensive experience in the IT industry, involved with full project life cycle, complete Software Development Life Cycle SDLC.

Extensive Knowledge in requirement gathering, analysis, design, development, implementation, testing, integration deployment, documentation and maintenance of IBM Mainframe applications

Hands on experience in COBOL,CICS,JCL,SQL,DB2,VSAM,FILE-AID,TSO/ISPF,,SPUFI,IBM UTILITIES .

Experience in Analysis, Design, Coding, and Testing & Production Support of application software in Mainframe platform.

Educational Background

Master of Technology in Communication Engineering – VIT University

Bachelors of Technology in Electronics and communication Engineering – VIT University

Technical Skills

Skill Set

Bigdata Testing,ETL testing, Mainframe Development

Big Data Platform

Hadoop 2.6,Hadoop 2.2

Bigdata tools

Hive,Sqoop,Pig, HDFS

Automation Testing Tools

SOAP UI Pro 4.5.2

Operating System

IBM Z/OS, UNIX, Windows 2000, Windows XP

Programming Languages

Bigdata Concepts,HIVE,SQOOP,PIG,COBOL,CICS,JCL,SQL,Flume

Databases & Tools

DB2,Oracle 11g, Informatica 9.xToad, HP ALM, Platinum, Expeditor, FILEAID

Other Utilities

SOAPUI PRO, JMTER 2.11, IBM Websphere MQ

Project /Test Management

Quality Centre 11.0

Collaboration Tool

SharePoint 2010

External Certifications

S.NO

Providers

Details

Technology

1.

Hortonworks

Hortonworks Certified Developer Exam (HDPCD) – Spark

Bigdata

2.

Hortonworks

Hortonworks Certified Developer Exam (HDPCD)

Bigdata

2.

ISTQB

ISTQB-BCS Certified Tester foundation level

Testing

3.

IBM

IBM -DB2-700- V8 Family fundamentals certification

IBM - DB2

4.

IBM

IBM –DB2-703-V8.1 Family Application Development

IBM - DB2

Relevant Project Experience

Project

Apple Music – FUSE

Duration

8month

Client

Apple Inc,

Locations

Sunnyvale, California

About the project

The Apple Music playback activity feed (a.k.a PAF) received from iTunes is send through series of in-line DQ checks, correction and enrichments as part of the Storm-S2F before it is loaded to GBI Core Layer. During these process, the playback activity feed is being updated with additional derived columns which are used for reporting and tracking. PAF data loaded in Core is further enriched during ESL processing in the Hive layer, the PAF after ESL process is known as PAF Extended, and the valid records is exposed to all downstream reporting applications through a view known as PAF view.

Role Details

Sr. Bigdata Test Analyst

Responsibility

Proving technical and functional knowledge to team members from Onsite.

Coordinating with onsite application teams and offshore team.

Reviewing the tested component by offshore team and application team.

Analysis/understanding of requirements and designing HIVE test scripts accordingly.

Creating required HQLs (Hive Query’s), for processing data which is made available using a large set of text files.

Work with executives, data owners, and data stewards to achieve data accuracy and process requirement goals for all internal and external customers and create data management strategies.

Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products

Constituent Hadoop scripts like HiveQL, Pig Latin are all robust

Validation of E2E Data Ingestion framework flow, which covers validation of data at landing zone to the parsed files stored at HDFS.

Involved in Bigdata Business fuctional validation through Hive, Framework Testing through Python based Dexter tool .

Platforms

Apache Hadoop, Apache Spark,NoSql,Hive, Pig, Apache Strom, Json, Terdata,Shell Scripts, Unix, HDFS

Project

Informatica Upgrade project V9.1 to v9.6

Duration

6 Months

Client

Northwestern Mutual Insurance

Locations

Milwaukee, WI – USA

About the project

Northwestern Mutual has a significant inventory of applications using Informatica as a data integration platform to move data from source to target databases, perform data transformations, and automate the extract, transform and load processes.

Informatica 9.0.1 is being used as a data integration and transformation tool. The upgrade to Informatica 9.6 will improve Informatica functionality, scalability and environment reliability, automation of data extract and transformation processes, and cost savings in maintenance and support.

Role Details

Sr. ETL Test Analyst

Responsibility

Proving technical and functional knowledge to team members from Onsite.

Coordinating with onsite application teams and offshore team.

Reviewing the tested component by offshore team and application team.

Executing test cases and updating results.

Extensively used Autosys for Informatica upgrade project testing.

Adhere to the client or project specific quality and documentation standards as part of project execution.

Validating the data files from source to make sure correct data has been captured to be loaded to target tables in both Infa 9.1 and Infa 9.6.

Preparation of Test Cases based on ETL Specification Document, Use Cases, Low Level Design document.

Performed analysis of Mapping Documents and 'Schema Compare' with Database tables, logged the defects and worked with the Database Modeling Team to resolve them

Worked on Autosys which involved in creation of Autosys jobs, execution

Platforms

ETL, Informatica 9.6,Informatica 9.1, IBM DB2, Sybase,SharePoint

Project

Big Data Advanced Analytics - Enterprise Search

Duration

18 Months

Client

California State Automobile Association (CSAA)

Locations

Coimbatore – India

About the project

Enterprise Search Platforms used by CSAA doesn’t support partial customer (or) policy searches and also it doesn’t support real time and facet based searches. Aim of Advance Analytics - Elastic Search project is to implement the centralized platform which can provide services to any systems that require AAA customer data at any time enabling the elastic & facet based searches. Raw Data from the heterogeneous customer & policy source databases will be loaded in to Hadoop - HDFS via scoop jobs. Once the data is available in HDFS, two tier business rules will be applied and the outcome records are stored in the form of documents. These document contents will be loaded in to elastic search cluster so that their attributes are indexed. Elastic Search cluster provides the required information to Enterprise Search applications by responding to the web service calls triggered by them thereby making the customer/policy searches faster and also enabling the real time & facet rule based searches.

Role Details

Sr. Bigdata Test Analyst

Responsibility

Analysis/understanding of requirements and designing HIVE test scripts accordingly.

Extracted/Import the data from RDMS Source side into HDFS using HDFS commands.

Importing and exporting data into HDFS and Hive using Sqoop.

Involved in loading data from UNIX file system to HDFS.

Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map.

Creating required HQLs (Hive Query’s), for processing data which is made available using a large set of text files.

Worked with Dev team and finding appropriate Hive TEZ properties to run the HIVE query.

Validation of E2E Data Ingestion framework flow, which covers validation of data at landing zone to the parsed files stored at HDFS.

Validation against HDFS file which has been created based on the Pig scripts.

Preparing the Test data and Inject the test data into Elastic search using of IBM MQ calls, JMTER.

Mimic the real time Test data and Inject into Elastic storm though IBM MQ calls, Apache Storm/Bold.

Involved Middleware testing by working with technologies like WSDL, SOAP, XML, Web Services and Message Queues.

Involved Web Services/SOA automation testing, Worked on web service and Rest API testing tools like SOAP UI 2.x and later.

Validation Web services API request, response data validations in REST API, SOAP protocols.

Automated Rest API validation through SoapUI Pro tool and successfully deployed.

Involved in validating the response JSON Response from ElasticSearch for the placed query string and facet rules in various input combinations, Including Typeahead, Multi tenancy, Sorting, Pagination Logics.

Monitoring the Cluster Queue performance and reporting to Dev Team.

Platforms

HDFS,Sqoop,Pig,Hive,XML,SoapUI,Storm,HUE,SOAPUI,JMETER,Elastic Search,TEZ, Cluster Queue, Ready ! API, Shell Scripts, XML, MQs

Project

Big Data Advanced Analytics –Legacy Claims Archival - Data Lake

About the project

The objectives of the Legacy Claims Archival project are to move all the claims legacy data from multiple source systems that is no longer actively used to HDFS for long term retention. Decommission Portfolio is planning to decommission the existing claims legacy systems once the data is moved to HDFS hence data quality in HDFS should match with legacy applications

Role Details

Sr. Bigdata Test Analyst

Responsibility

Analysis/understanding of requirements and designing data injection plan accordingly.

Extracted/Import the data from Oracle 11g, SQL server, Mainframe VSAM file, in both AVRO and ORC layers.

Involved in both Initial and incremental load validation.

Validated the Mainframe VSAM file to Hadoop HDFS file with mainframe copy book.

Involved Test Automation through Platinum implementation for AVRO, ORC layer in Both Source to Hive and Hive to Hive.

Implemented Test Automation through Platinum Automation tool with following advantages.

Tables with huge volume (more than 5GB file size) can be validated

Count, Data & Duplicate in one single run for each table

Output is generated in .html (readable format) and redirects to mismatches/duplicates if any

Different environments can be connected and validation can be done

Project

Kemper GuideWire Data Conversion

Duration

18 Months

Client

Kemper Corporation

Locations

Coimbatore – India

About the project

The Objective of this project is to provide a single platform for claims processing through Guide Wire Claims Center through Conversion of existing claims from Legacy systems to the new Guide Wire Claims Administration System. Claims from legacy systems should migrate to GW Operational DB and GW Archival DB as per the business requirements

Role Details

Sr. ETL Test Analyst

Responsibility

Participated actively in understanding the requirements from work request document given by the business.

Participated actively in knowing the functionality of the each of the component involved in the architecture other than databases.

Participated actively in requirement and design discussions and participated in coming up with effective solutions.

Involved in Test Plan & Test Scenario Creation

Involved in designing the functional test cases associated to each of work requests.

Participated actively in execution of Test cases for both database & other areas.

Logged defects in HP ALM and worked proactively with the QA team lead and developers to resolve any issues that inhibited during testing.

Platforms

Informatica, Oracle, SQL, HP Qulaity center.

Project

Well point –SSCR Projects

Duration

18 Months

Client

Well Point

Locations

Coimbatore – India

About the project

The project involves the functional processing of small and Large Group Claims through a common Claims system for WELLPOINT client (Healthcare Domain). The claims SSCR project is a maintenance project to enhance the existing WGS and STAR (individual and small group claims) systems. This involves intense business analysis and documentation, Design, Coding, Testing and implementation. The project involved a lot of System study and understanding of the business level Claims Processing happening in both the systems.

Responsibility

Analyzing the existing code and documenting the analysis results.

Supporting the region with monitoring jobs and resolving the issues.

Involvement in Requirement, Design, Construction, Testing, Implementation.

Mentoring the new members in the project.

Platforms

Mainframe,COBOL,JCL,CICS,DB2, ENDEVOR, File-Aid DB2, Expediter

Project

Agent Portal – Production Support

Duration

12 Months

Client

Mutual Of Omaha.

Locations

Chennai- India

Role Details

Senior Developer

About the project

This is a Support and maintenance Project .Mutual of Omaha (MoO) is looking maintenance, support and Performance improvements for their legacy system (Field comp System). The scope of the project includes maintaining the business applications that are critical in nature, enhancing the performance of these systems and reducing the cost factor on a whole. The objective of this effort is proactive monitoring, enhancing, identification, mitigation and resolution of events that negatively impact the system.

Key Points

Given solution for around 50 % of the cost saved by running some of the applications in the Mainframe environment by performance tuning as a value add.

Have given knowledge transfer to the other teams. The other teams started implementing this concept.

Platforms

Co-ordinate with onsite team to gather requirements and understand the processes.

Estimate the efforts for Projects, Change Requests and Enhancements from a technical standpoint.

Handle Change Requests from Business users and Business Analysts.

Report the status from time to time to Managers and Client.

Develops technical designs that will meet system objectives and minimize the impact on operations

CAT and Production Support – Bug Fixes, Process Support & Assistance.

Review the design documents and codes done by other offshore team members

Preparing Test Cases and Test Scenarios

Perform Unit testing

Provide support to the system testing and resolve issues raised by system testing team

Mentor and Coached my Team members, and peers for them to quickly understand the projects and processes.

Ensure process compliance.

Summary – Other Projects

S.NO

Client

Project

Technology

Roles and Responsibilities

1.

Mutual Of Omaha,USA

Agent Portal– Production Support

MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,IBM UTILITIES

• Production Support Developer

• Testing Lead

2.

Well point - Health care,USA

Well point –SSCR Projects

MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES

• Sr.IBM mainframe Developer

• Technical Lead – Reg gathering, Dev, Testing.

3.

Target Corporation,USA

Item Management

MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES

• IBM mainframe Developer

• Technical Lead

4.

Woolworths Limited, Australia

Promotional Screen Development

MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES

• IBM mainframe Developer

• Technical Lead



Contact this candidate