Karthikeyan Rasipalayam Durairaj
+1-414-***-**** *************@*****.***
Experience Summary
Around 8+ years of IT experience in Data warehousing, Bigdata, Mainframe and RDBMS in design, development, testing, implementation and support of enterprise data warehouse. Experienced in Requirement Analysis, Test Design, Test Preparation, Test Execution, Defect Management, and Management Reporting.
Bigdata Testing Experience:
Hortonworks Certified Developer (HDPCD) by Hortonworks.
Extensively worked on Hadoop Ecosystems testing like HDFS, HIVE, PIG, SQOOP,JAVA and successfully deployed Enterprise Search, Real time data Testing, Data Lake projects.
Automated JSON Parsing, XML file paring using domp parser in Java Environment.
Experience in Big Data ingestion tools like Sqoop, Flume, HDFS commends.
Automated JSON Parsing, XML file paring using domp parser in Java Environment.
Good knowledge in Apache Storm and Hands on Testing Experience in streaming data into Elastic Search.
Experience in testing Middleware - SOA, Rest API & Integration testing.
Experience in Project Lead and Management activities, Involved in Requirements study and Analysis, Test Plan/Design/Metrics, UAT Support
Hands on Testing experience in Enterprise Level Data Lake in Hadoop Platform for various data sources like Oracle, SQL Server, DB2, AS400 and Mainframe VSAM file etc.
Testing Design for Data Lake for the Enterprise using Apache Hadoop and it's Ecosystems
Design and Architect the Enterprise Level Hadoop solutions for Various Use Cases
Experience in REST API testing using message queues IBM Websphere MQ, JMETER, SoapUI, Elasticsearch and any supporting tool.
ETL/Data Testing Experience:
Understanding the Business requirement document (BRD) and Data mapping document (DMD) completely and implements testing methodologies.
Experience in writing complex SQL to examine sample record sets for consistency, data corruption and over all data quality
Preparing the test case in QC and managing the related activities
Extensive testing ETL experience using Informatica 9.1/9.6 (Power Center/ Power Exchange) (Designer, Workflow Manager, Workflow Monitor).
Experienced in dealing with clients to gather requirements, understanding the Business requirements, product demonstrations and providing product support.
Extensively used ETL methodology for supporting data extraction, transformations and loading processing in a corporate-wide-ETL Solution.
Hands on experience with analysis of business, technical, and functional requirements and Developed, Executed test plans, test cases and test strategies.
Experience with software change management tool Rational Clear Case for versioning the documents and maintaining the document repository.
Mainframe Development Experience:
Sr. IBM Mainframe Application developer, hands on experience in application development. Extensive experience in the IT industry, involved with full project life cycle, complete Software Development Life Cycle SDLC.
Extensive Knowledge in requirement gathering, analysis, design, development, implementation, testing, integration deployment, documentation and maintenance of IBM Mainframe applications
Hands on experience in COBOL,CICS,JCL,SQL,DB2,VSAM,FILE-AID,TSO/ISPF,,SPUFI,IBM UTILITIES .
Experience in Analysis, Design, Coding, and Testing & Production Support of application software in Mainframe platform.
Educational Background
Master of Technology in Communication Engineering – VIT University
Bachelors of Technology in Electronics and communication Engineering – VIT University
Technical Skills
Skill Set
Bigdata Testing,ETL testing, Mainframe Development
Big Data Platform
Hadoop 2.6,Hadoop 2.2
Bigdata tools
Hive,Sqoop,Pig, HDFS
Automation Testing Tools
SOAP UI Pro 4.5.2
Operating System
IBM Z/OS, UNIX, Windows 2000, Windows XP
Programming Languages
Bigdata Concepts,HIVE,SQOOP,PIG,COBOL,CICS,JCL,SQL,Flume
Databases & Tools
DB2,Oracle 11g, Informatica 9.xToad, HP ALM, Platinum, Expeditor, FILEAID
Other Utilities
SOAPUI PRO, JMTER 2.11, IBM Websphere MQ
Project /Test Management
Quality Centre 11.0
Collaboration Tool
SharePoint 2010
External Certifications
S.NO
Providers
Details
Technology
1.
Hortonworks
Hortonworks Certified Developer Exam (HDPCD) – Spark
Bigdata
2.
Hortonworks
Hortonworks Certified Developer Exam (HDPCD)
Bigdata
2.
ISTQB
ISTQB-BCS Certified Tester foundation level
Testing
3.
IBM
IBM -DB2-700- V8 Family fundamentals certification
IBM - DB2
4.
IBM
IBM –DB2-703-V8.1 Family Application Development
IBM - DB2
Relevant Project Experience
Project
Apple Music – FUSE
Duration
8month
Client
Apple Inc,
Locations
Sunnyvale, California
About the project
The Apple Music playback activity feed (a.k.a PAF) received from iTunes is send through series of in-line DQ checks, correction and enrichments as part of the Storm-S2F before it is loaded to GBI Core Layer. During these process, the playback activity feed is being updated with additional derived columns which are used for reporting and tracking. PAF data loaded in Core is further enriched during ESL processing in the Hive layer, the PAF after ESL process is known as PAF Extended, and the valid records is exposed to all downstream reporting applications through a view known as PAF view.
Role Details
Sr. Bigdata Test Analyst
Responsibility
Proving technical and functional knowledge to team members from Onsite.
Coordinating with onsite application teams and offshore team.
Reviewing the tested component by offshore team and application team.
Analysis/understanding of requirements and designing HIVE test scripts accordingly.
Creating required HQLs (Hive Query’s), for processing data which is made available using a large set of text files.
Work with executives, data owners, and data stewards to achieve data accuracy and process requirement goals for all internal and external customers and create data management strategies.
Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
Constituent Hadoop scripts like HiveQL, Pig Latin are all robust
Validation of E2E Data Ingestion framework flow, which covers validation of data at landing zone to the parsed files stored at HDFS.
Involved in Bigdata Business fuctional validation through Hive, Framework Testing through Python based Dexter tool .
Platforms
Apache Hadoop, Apache Spark,NoSql,Hive, Pig, Apache Strom, Json, Terdata,Shell Scripts, Unix, HDFS
Project
Informatica Upgrade project V9.1 to v9.6
Duration
6 Months
Client
Northwestern Mutual Insurance
Locations
Milwaukee, WI – USA
About the project
Northwestern Mutual has a significant inventory of applications using Informatica as a data integration platform to move data from source to target databases, perform data transformations, and automate the extract, transform and load processes.
Informatica 9.0.1 is being used as a data integration and transformation tool. The upgrade to Informatica 9.6 will improve Informatica functionality, scalability and environment reliability, automation of data extract and transformation processes, and cost savings in maintenance and support.
Role Details
Sr. ETL Test Analyst
Responsibility
Proving technical and functional knowledge to team members from Onsite.
Coordinating with onsite application teams and offshore team.
Reviewing the tested component by offshore team and application team.
Executing test cases and updating results.
Extensively used Autosys for Informatica upgrade project testing.
Adhere to the client or project specific quality and documentation standards as part of project execution.
Validating the data files from source to make sure correct data has been captured to be loaded to target tables in both Infa 9.1 and Infa 9.6.
Preparation of Test Cases based on ETL Specification Document, Use Cases, Low Level Design document.
Performed analysis of Mapping Documents and 'Schema Compare' with Database tables, logged the defects and worked with the Database Modeling Team to resolve them
Worked on Autosys which involved in creation of Autosys jobs, execution
Platforms
ETL, Informatica 9.6,Informatica 9.1, IBM DB2, Sybase,SharePoint
Project
Big Data Advanced Analytics - Enterprise Search
Duration
18 Months
Client
California State Automobile Association (CSAA)
Locations
Coimbatore – India
About the project
Enterprise Search Platforms used by CSAA doesn’t support partial customer (or) policy searches and also it doesn’t support real time and facet based searches. Aim of Advance Analytics - Elastic Search project is to implement the centralized platform which can provide services to any systems that require AAA customer data at any time enabling the elastic & facet based searches. Raw Data from the heterogeneous customer & policy source databases will be loaded in to Hadoop - HDFS via scoop jobs. Once the data is available in HDFS, two tier business rules will be applied and the outcome records are stored in the form of documents. These document contents will be loaded in to elastic search cluster so that their attributes are indexed. Elastic Search cluster provides the required information to Enterprise Search applications by responding to the web service calls triggered by them thereby making the customer/policy searches faster and also enabling the real time & facet rule based searches.
Role Details
Sr. Bigdata Test Analyst
Responsibility
Analysis/understanding of requirements and designing HIVE test scripts accordingly.
Extracted/Import the data from RDMS Source side into HDFS using HDFS commands.
Importing and exporting data into HDFS and Hive using Sqoop.
Involved in loading data from UNIX file system to HDFS.
Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map.
Creating required HQLs (Hive Query’s), for processing data which is made available using a large set of text files.
Worked with Dev team and finding appropriate Hive TEZ properties to run the HIVE query.
Validation of E2E Data Ingestion framework flow, which covers validation of data at landing zone to the parsed files stored at HDFS.
Validation against HDFS file which has been created based on the Pig scripts.
Preparing the Test data and Inject the test data into Elastic search using of IBM MQ calls, JMTER.
Mimic the real time Test data and Inject into Elastic storm though IBM MQ calls, Apache Storm/Bold.
Involved Middleware testing by working with technologies like WSDL, SOAP, XML, Web Services and Message Queues.
Involved Web Services/SOA automation testing, Worked on web service and Rest API testing tools like SOAP UI 2.x and later.
Validation Web services API request, response data validations in REST API, SOAP protocols.
Automated Rest API validation through SoapUI Pro tool and successfully deployed.
Involved in validating the response JSON Response from ElasticSearch for the placed query string and facet rules in various input combinations, Including Typeahead, Multi tenancy, Sorting, Pagination Logics.
Monitoring the Cluster Queue performance and reporting to Dev Team.
Platforms
HDFS,Sqoop,Pig,Hive,XML,SoapUI,Storm,HUE,SOAPUI,JMETER,Elastic Search,TEZ, Cluster Queue, Ready ! API, Shell Scripts, XML, MQs
Project
Big Data Advanced Analytics –Legacy Claims Archival - Data Lake
About the project
The objectives of the Legacy Claims Archival project are to move all the claims legacy data from multiple source systems that is no longer actively used to HDFS for long term retention. Decommission Portfolio is planning to decommission the existing claims legacy systems once the data is moved to HDFS hence data quality in HDFS should match with legacy applications
Role Details
Sr. Bigdata Test Analyst
Responsibility
Analysis/understanding of requirements and designing data injection plan accordingly.
Extracted/Import the data from Oracle 11g, SQL server, Mainframe VSAM file, in both AVRO and ORC layers.
Involved in both Initial and incremental load validation.
Validated the Mainframe VSAM file to Hadoop HDFS file with mainframe copy book.
Involved Test Automation through Platinum implementation for AVRO, ORC layer in Both Source to Hive and Hive to Hive.
Implemented Test Automation through Platinum Automation tool with following advantages.
Tables with huge volume (more than 5GB file size) can be validated
Count, Data & Duplicate in one single run for each table
Output is generated in .html (readable format) and redirects to mismatches/duplicates if any
Different environments can be connected and validation can be done
Project
Kemper GuideWire Data Conversion
Duration
18 Months
Client
Kemper Corporation
Locations
Coimbatore – India
About the project
The Objective of this project is to provide a single platform for claims processing through Guide Wire Claims Center through Conversion of existing claims from Legacy systems to the new Guide Wire Claims Administration System. Claims from legacy systems should migrate to GW Operational DB and GW Archival DB as per the business requirements
Role Details
Sr. ETL Test Analyst
Responsibility
Participated actively in understanding the requirements from work request document given by the business.
Participated actively in knowing the functionality of the each of the component involved in the architecture other than databases.
Participated actively in requirement and design discussions and participated in coming up with effective solutions.
Involved in Test Plan & Test Scenario Creation
Involved in designing the functional test cases associated to each of work requests.
Participated actively in execution of Test cases for both database & other areas.
Logged defects in HP ALM and worked proactively with the QA team lead and developers to resolve any issues that inhibited during testing.
Platforms
Informatica, Oracle, SQL, HP Qulaity center.
Project
Well point –SSCR Projects
Duration
18 Months
Client
Well Point
Locations
Coimbatore – India
About the project
The project involves the functional processing of small and Large Group Claims through a common Claims system for WELLPOINT client (Healthcare Domain). The claims SSCR project is a maintenance project to enhance the existing WGS and STAR (individual and small group claims) systems. This involves intense business analysis and documentation, Design, Coding, Testing and implementation. The project involved a lot of System study and understanding of the business level Claims Processing happening in both the systems.
Responsibility
Analyzing the existing code and documenting the analysis results.
Supporting the region with monitoring jobs and resolving the issues.
Involvement in Requirement, Design, Construction, Testing, Implementation.
Mentoring the new members in the project.
Platforms
Mainframe,COBOL,JCL,CICS,DB2, ENDEVOR, File-Aid DB2, Expediter
Project
Agent Portal – Production Support
Duration
12 Months
Client
Mutual Of Omaha.
Locations
Chennai- India
Role Details
Senior Developer
About the project
This is a Support and maintenance Project .Mutual of Omaha (MoO) is looking maintenance, support and Performance improvements for their legacy system (Field comp System). The scope of the project includes maintaining the business applications that are critical in nature, enhancing the performance of these systems and reducing the cost factor on a whole. The objective of this effort is proactive monitoring, enhancing, identification, mitigation and resolution of events that negatively impact the system.
Key Points
Given solution for around 50 % of the cost saved by running some of the applications in the Mainframe environment by performance tuning as a value add.
Have given knowledge transfer to the other teams. The other teams started implementing this concept.
Platforms
Co-ordinate with onsite team to gather requirements and understand the processes.
Estimate the efforts for Projects, Change Requests and Enhancements from a technical standpoint.
Handle Change Requests from Business users and Business Analysts.
Report the status from time to time to Managers and Client.
Develops technical designs that will meet system objectives and minimize the impact on operations
CAT and Production Support – Bug Fixes, Process Support & Assistance.
Review the design documents and codes done by other offshore team members
Preparing Test Cases and Test Scenarios
Perform Unit testing
Provide support to the system testing and resolve issues raised by system testing team
Mentor and Coached my Team members, and peers for them to quickly understand the projects and processes.
Ensure process compliance.
Summary – Other Projects
S.NO
Client
Project
Technology
Roles and Responsibilities
1.
Mutual Of Omaha,USA
Agent Portal– Production Support
MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,IBM UTILITIES
• Production Support Developer
• Testing Lead
2.
Well point - Health care,USA
Well point –SSCR Projects
MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES
• Sr.IBM mainframe Developer
• Technical Lead – Reg gathering, Dev, Testing.
3.
Target Corporation,USA
Item Management
MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES
• IBM mainframe Developer
• Technical Lead
4.
Woolworths Limited, Australia
Promotional Screen Development
MVS TSO/ISPF,DB2, SQL, COBOL,VSAM,JCL,CICS, IBM UTILITIES
• IBM mainframe Developer
• Technical Lead