Hadoop Data Qa Lead
Resume:
Karteek V
*******.******@*****.***
Lead QA
Summary:
●Working as a QA Lead with 11+ Years of Experience.
●Across all projects actively involved in all phases of STLC right from understanding of requirements, preparing Test Plan, Test Scenarios and cases, Defects Tracking, UAT Support and up to providing post Implementation Support.
●Experienced with ETL/Data warehouse Testing
●Experienced with Big-Data technologies
●Experienced in BI Testing.
●Good knowledge in Data Modeling.
●Experienced in Manual Testing.
●Experienced in working UNIX/Linux environment
●Good experience in Testing Analytical Applications.
●Good knowledge in Security Testing(Manual Penetration Testing)
●Good knowledge in Performance Testing.
●Experience in Amazon S3
●Experienced in Retail, Health care, Capital Market, Manufacturing and Insurance Domains
●ETL Testing Responsibilities:
●Designing SQL queries (Simple and Complex), Sub Queries to perform backend / Database testing of different connectors like (MySQL, JDE Oracle, SQL Server, DB2 AS400, Epicor with SQL Server )
●Prepared and ran SQL queries to verify Dimensional and Fact tables.
●Verifying the data in target database after ETL process.
●Performed column data mapping between source & target database.
●Involved in the validation of work flows and mappings in Informatica tool
●Hadoop Big Data Testing Responsibilities
oData staging Validation - Ensuring that the intended data is loaded into Hadoop system – which involves comparing the source data with HDFS data, comparison of counts, checking data quality, verification of HDFS directory for the correctness of target path
oMap Reduce Validation – Ensuring that the correct key/value pairs are generated based on the input format type, verifying that the data is sorted, validating output directory to make sure that number of files created should be same as number of reducers, verifying that the filter provided through the Distributed cache is picked up and only the intended data is written to output, verification of aggregations in the final output, validation of the counters and custom practitioners.
oScheduling Validation – Involved in the verification of oozie work flows to see that the order of the jobs are correct and actions to be takes are correct in case of failures.
●HIVE Responsibilities
●comfortable with loading raw data into hive tables
●Knowledge on static and dynamic partitions in hive tables.
●Comfortable with join queries and aggregations
●Developed integration scripts between Hive and Hbase.
●RDBMS Responsibilities
●Having a good knowledge of SQL concepts and Implementation of the same
●Proficient with Union, Joins and Sub queries to develop medium to complex queries
●Experienced to use DDL, DML and DCL statements of SQL
●Comfortable to use aggregation functions of SQL
●BI Testing Responsibilities
●Verify data is mapped correctly from source to target system.
●Ensuring that all tables and their fields are copied from source to target.
●Verify transformations are applied correctly
●Verifying Null, duplicates, precision, count, aggregations etc
●Verifying data in BI Reports and Dashboards
●Automation Testing Responsibilities
Used Selenium Web Driver for automation, comfortable with handling multiple browsers, various objects like Text Box, List Box, Links, Images, Tables, Labels.
Expert in identifying the locators using firebug tool
Comfortable with the coding of xpath, screen capture, handling alerts, scrolling logics, multiple windows
Comfortable with Selenium parameterization to test with multiple sets of data
Comfortable with test frame works like TestNG
Comfortable with Page Object Model.
Comfortable with creating TestNG Framework using annotations.
●Manual Testing Responsibilities:
Understand and analyze business and functional requirements.
Involved in Test Planning.
Prepare RTM based on the requirements.
Creating Test Data based on the requirements.
Functional testing on Java and Dot net based applications.
●As a Test Lead
Responsible for Testing Estimation
Involved in Test Planning.
Organized DEV to QA Handoff meeting to get understanding of QA team with the actual changes planned for a release
Conducted Test plan walkthrough with the QA and Business team
Set up Test Results walkthrough with the business team for getting the approvals
Organized weekly status meetings to identify the risks and status of the project
Escalating the risks to management and Identifying the mitigation plans with the management team
One on One with all team members
Connecting the different groups of people based on the dependencies of the project and Following up with testers.
Preparing Weekly Status Report (WSR) and monthly status reports.
Quarterly review for every team member.
Involved in annual appraisal for Team Members.
●As a Test Lead below metrics has been collected
Classifying the Defect data by Release wise based on the criticality (Critical, High, Medium and Low)
Defects summary by Release and Status (Open, Closed, Duplicate, Reopen, Rejected, Postponed, Retest, Cancelled) and Calculating the Defect Rejection Ratio
Defects summary by project wise and showing the % Critical and % High Defects
Average Turnaround time took to change the defect from one status to other (From New to Open or Open to Fixed)
Defect Life cycle ( Like In each cycle how many defects are falling), this shows like how may defects from invalid to valid
Calculate the percentage of wrong rejects and valid rejects
Calculate the percentage of wrong reopens and valid reopens
Technical Skills
●ETL Informatica, Hadoop Big Data technologies HDFS, Map Reduce, PIG, HIVE, HBASE, Oozie, Sqoop, SparkSQL and Presto.
●Unix/Linux commands.
●Connectors: MySQL, JDE Oracle, SQL Server, DB2 AS400, Epicor with SQL Server (Epicor 9/10), Dynamics AX 2009/2012, MS Access, Mongo DB.
●Web Services (SoapUI), Selenium Web Driver
●Version control Tool: SVN
●Informatica & Talend.
●HP Quality Center, JIRA and Tuleap
●MS Office Applications like MS Word, MS Excel, PowerPoint and VISIO.
●Certified Scrum Master (Scrum Alliance)
Professional Details:
Working as Lead QA Consultant for CME Group Inc (Chicago Merchant Exchange) from October 2017 to Till Date.
Worked as Lead QA for Anvizent Analytics Pvt Ltd (Subsidiary of DW Practice India Pvt Ltd) from July 2014 to August 2017.
Worked as Lead QA for Mind Tree from November 2009 to June 2014
Project Experience:
CME- ICS(Instrument Creation Service) Oct 2017- Till date
Role: Lead QA
Location: Chicago USA
Chicago Mercantile Exchange & Chicago Board of Trade is a global markets company. CME is a derivative exchange; it is a market where individual’s trade standardized contracts that has been defined by the exchange. It owns large derivatives, options and futures exchanges in Chicago and New York City using its CME Globex trading platforms. It also owns CME Clearing which provides settlement and clearing of exchange trades.CME exchange acts as an intermediary to all related transactions, and takes initial margin from both sides of the trade to act as a guarantee. CME Group offers the widest range of global benchmark products across all major asset classes based on interest rates, equity indexes, foreign exchange, energy, agricultural products and metals. Options, Futures and UDS are trading instruments which are created by Instrument Creation Service (ICS).
Roles and Responsibilities:
●Built cohesive test team who shared best practices, test responsibilities, and supported reuse of test cases. Increased test coverage and efficiency without increasing test engineer headcount.
●Successfully leveraged resources across multiple projects to do more with less. Consistently met project milestones for multiple simultaneous projects.
●Coordinated test strategy development, project planning, scheduling, allocation of test engineers to programs, ensuring test environment availability, generation of test reports, communication of test status, and networking to coordinate test activities.
●Coordinated with partners to document and assess acceptance criteria.
●Pushed for improvements in software development practices to increase software maturity prior to delivery to test team.
●Focused on employee growth to give test engineers visibility and accountability for their work. Recognized by managers for ability to get the most out of individuals.
●Greatly improved integration of test engineers with development teams resulting in a cohesive work environment.
Prifender Mar 2016 - Aug 2017
Banglore -India
Role: Lead QA
Prifender client deals with people information, In Stage-A data flows from different sources and injected into Data lake, In Stage-B data is transformed based on the business requirements is then loaded into down streaming applications.
Roles and Responsibilities:
●Understood the data from various source systems and their business importance
●Interacted with Data architect, ETL, Hadoop Administration and Metadata teams
●Attended daily agile meetings to provide the present status of work and road blocks
●Test case preparation and test results validation across multiple zones in the Hadoop data lake
●Involved in the validation of ETL mappings and work flows and their schedules
●Prepared test plan based on the scope and business requirements
●Proficient with below Hive Activities
oVerified and made sure the files are landed into the landing zone from various sources
oValidated Hive Schemas to make sure they are in sync with the given mapping sheet
oValidated Hive tables properties like compression, file type and delimiters
oValidated fields definition as per the given mapping sheet
oCompared the data between different zones to make sure the data is transformed as expected and no loss in the data
oDeveloped medium to complex HiveQL queries to complete the validation
●Verified the scheduler for the jobs implementation, pre and post requisites
MINI-DW (Data Warehousing tool)
July 2014 - Feb 2016
Banglore -India
Role: Lead QA
Mini-DW is comprehensive solution suite that enables easy Data warehousing activities like Extraction, Transformation and Cleansing & Loading. Where users can also schedule packages and run jobs to process data from Source to Target.
Roles and Responsibilities:
●Assigning various tasks to the team as per strength of individual.
●Coordinating activities and enforce quality improvements.
●Resolving conflicts among team members.
●Preparation of Test data.
●Extracting data from different sources like Flat Files, Database & Webservices.
●Verifying data from Source to Target.
●Prepared and Ran SQL queries to verify data.
●Performed column data mapping between source & target database.
●Validating data file in S3.
●Worked in AWS environment.
●Responsible to provide sign off based on the testing performed in Test and QA Environments.
●Responsible to provide the test results and log the mismatches in issue tracking tool Tuleap.
MINI-DW (Druid & ELT)
July 2014 - Feb 2016
Banglore -India
Role: Lead QA
Mini-DW Druid is a data store designed for high performance slice and dice analytics on large data sets. Druid is used as a data store for powering GUI analytical applications.
Roles and Responsibilities:
●Import or Create Collections in Postman
●Data validation through POSTMAN tool (DB validations like Group By, Order By, etc)
●Validation data in POSTMAN to Dashboard
●Design 3 types of Configuration(config) files like Main, Staging and FK(foreign key)
● Designing 'Configuration' and 'Value' file through Workflow
●Sources like Source SQL, Source CSV, and Source S3 CSV
● Filters using Regular Expressions
● Transformations/Operations like Expression, Lookup, Fetcher, GroupBy, Join, Sequence, Union.
● Sink/Target like SQL Sink, CSV Sink, and S3 Json Sink.
● Mapping source table config file to feed data into Target table
● Export workflow/Config file into External source to create Job tags
Anvizent (Analytics Tool)
July 2014 - Feb 2016
Banglore -India
Role: QA Lead
Anvizent is a comprehensive solution suite that enables easy development of visual representations of data and provides a versatile dashboard interface for data consumers to analyze and draw actionable insights from the visualizations. Anvizent stands out of the crop of BI tools by virtue of its feature-rich yet easy-to-build interface and penetrating reach across platforms.
Roles and Responsibilities:
●Acted as a QA Lead and coordinated the Certification Activities with other 3 team members
●Defining Quality standards and metrics for the current product.
●Working with all stake holders to ensure that the quality metrics are reviewed, closed and agreed upon.
●Make QA-team aware of the Quality matrix and resolve all the queries.
●Ensure the team is focusing on automation along with manual testing.
●Work closely on the deadlines.
●Prepared and ran SQL queries to verify Dimensional and Fact tables.
●Verifying the data in target database after ETL process.
●Verifying data from data warehouse to BI Tool (Dashboards/Reports).
●Performed column data mapping between source & target database.
●Prepared test data for testing.
●Involved in functional testing.
●Reviewed Test Scripts and Designed test data.
●Identified Test Scripts for Regression testing.
●Worked on SQL Server Management Studio & MySQL to validate the data.
●Involved in performance testing
●Identified Test cases which can be automated.
●Tested in different types of deployments: On Cloud, On Premise & Hybrid
●Defect Analyzing and Reporting in JIRA.
●Reviewing test scenarios & Strategies and see that all the various kinds of testing like unit, functional, performance, stress, acceptance etc are getting covered.
Anvizent (Customer Implementations)
July 2014 - Feb 2016
Banglore -India
Role: QA Lead
Anvizent Implementations - is creating dashboards as per customer requirement and extracting data from customer database and mapping the same to the dimensions and measures in the dashboards. This allows users to analyse the data using the dashboards.
Roles and Responsibilities:
●Designing SQL quires (Simple and Complex), Sub Quires to perform backend / Database testing of different connectors like :
oMySQL
oJDE Oracle
oSQL Server
oDB2 AS400
oEpicor with SQL Server (Epicor 9/10)
oDynamics AX 2009/2012
oMS Access
●Developing scripts to pull data or prepare metrics from multiple tables using Joins, conditional statements, SQL functions, CTE, Temporary tables, Worktables.
●Worked with different ERP’s : Microsoft Dynamics, JD Edwards & SAP B1.
●Worked on different modules in ERP systems for different clients:
oHuman Resource
oInventory
oSales & Marketing.
oPurchase.
oFinance & Accounting.
oCustomer Relationship Management(CRM)
oEngineering/ Production.
oSupply Chain Management (SCM)
Mflix World
Jan 2013 - June 2014
Banglore -India
Role: QA Lead
The project is to develop a platform to release new movies primarily intended for Indian Audience. Movies scheduled for releases are uploaded into the application and made available on the website accessed through any device - mobile or desktop from anywhere in the world, however only for a pre-determined period of time. For mobile, additionally there are native applications developed and managed. Movie watching is primarily a geography restricted, paid and securely streamed service.
Roles and Responsibilities:
●Assigning various tasks to the team as per strength of individual.
●Coordinating activities and enforce quality improvements.
●Resolving conflicts among team members
●Maintaining cordial relationship between cross functional teams like development, configuration management, programme management, Product managers etc.
●Involved in functional study of the application.
●Involved in functional testing.
●Interactions with BA & Dev teams to resolve the issues.
●Defect Analyzing and Reporting in JIRA.
●Involved in Load testing in Apache Jmeter 2.13.
●Reviewing test scenarios & Strategies and see that all the various kinds of testing like unit, functional, performance, stress, acceptance etc are getting covered.
ActiveWrite
June 2011 - Dec 2012
Banglore -India
Role: QA Lead
Activewrite is a product used to create document creation, editing and creating. It is tackling one of the most challenging problems in content management -making sure content is up to date, accurate, consistent and in compliance across an enterprise.
Roles and Responsibilities:
●Comfortable with all STLC activities
●Used Test case Point Testing estimation technique for estimations
●Understanding of Business requirements given by different carriers
●Understanding the SRS Technical Environment
●Coordinated with Development and BA team on clarification of the requirements
●Prepared test plan and presenting the same to team
●Test cases has been developed for the defined test requirements in QC
●Hands on experience in preparing both positive and negative test scenarios
●Perform Security testing and generating reports.
●Execution of test cases and proving the results.
●Perform Functional, Regression and Adhoc testing.
●Written Production Test cases and executed the same.
●Identifying defects and reporting through TULEAP.
●Involved in build deployment.
Core Foundation Services
June 2010 - May 2011 Banglore –India
Role: Sr Quality Analyst
MF Global is a leading Cash and Derivative Broker Dealer dealing in Commodities, Derivatives, FX etc. Core Foundation Services is an application for data capture and reporting systems, to enable managers at all levels to evaluate opportunities and make decisions. This project collects all the trading system data across the global locations, centralize it, perform the checks on data received from source perform the calculations and store it into the target table. Users can generate there reports to do dealing in Commodities, Derivatives in a simplified way.
Roles and Responsibilities:
●Involved in client interaction and co-ordination regarding issues & queries resolution.
●Involved in functional study of the application
●Running the Jobs/Workflow for ETL process
●Prepared and ran sql queries to verify Dimensional and Fact tables.
●Verifying the data in target database after ETL process
●Performed column data mapping between source & target database.
Health Management System (HMS)
November 2009 - May 2010
Banglore -India
Role: Sr Quality Analyst
Hospital management system is up and running in KMC where all the operational details are stored. Management needed a dash board system to keep track of nursing, inventory, pharmacy, in-patient and HR related KPI’s.
Roles and Responsibilities:
●Understanding of statement of need, Functional specifications and Technical specifications
●Identifying Test requirements
●Writing test cases for the defined test requirements
●Hands on experience in preparing both positive and negative test scenarios
●Executing the test cases
●Follow up with the developers for all project related issues and defects
●Endevor has been used as a change control tool for code promotions
●Preparing weekly status reports to track the status of testing
●Participated in meetings with project manager and business people
Contact this candidate