Post Job Free

Resume

Sign in

Sr.Informatica Developer/IDQ/MDM/Data Analyst

Location:
North Chicago, IL
Salary:
$65/hr on C2C
Posted:
October 03, 2019

Contact this candidate

Resume:

ARUN K

980-***-****

adaieq@r.postjobfree.com

Sr.Informatica Developer/IDQ/MDM/Data Analyst

PROFESSIONAL SUMMARY:

8+ years of IT Experience in Data Warehousing, Database Design and ETL Processes in various business domains like finance, telecom, manufacturing and health care industries.

Highly proficient in Development, Implementation, Administration and Support of ETL processes for Large-scale Data warehouses using Informatica Power Center.

Worked extensively on ETL process using Informatica PowerCenter 9.x/8.x/7.x. Informatica Data Quality(IDQ) 9.6.1, Informatica MDM and Informatica B2B

Extensively used ETL methodologies for supporting Data Extraction, Transformation and Loading process, in a corporate-wide-ETL solution using Informatica Power Center.

Extensively worked on developing Informatica Designer, Workflow manager and Workflow monitor for data loads.

Experience working with Cloud Computing on Platform Salesforce.com

Extensive experience in using various Informatica Designer Tools such as Source Analyzer, Transformation Developer, Mapping Designer, Mapplet Designer.

Extensive experience in Design, Development, Implementation, Production Support and Maintenance of Data Warehouse Business Applications in E-commerce software, Utility, Pharmaceutical, Health Care, Insurance, Financial and Manufacturing industries.

Experience in development and maintenance of SQL, PL/SQL, Stored procedures, functions, analytic functions, constraints, indexes and triggers.

Experienced in IDQ (9X, 9.5.1) handing LDO’s PDO’s & some of the transformation to cleanse and profile the incoming data by using Standardizer, Labeler, Parser, Address Validator Transformations8 years of experience in using different versions of Oracle database like 11g/10g/9i/8i.

Excellent working knowledge of c shell scripting, job scheduling on multiple platforms, experience with UNIX command line and LINUX.

Proficient with Informatica Data Quality(IDQ) for cleanup and massaging at staging area.

Experience in creating batch scripts in DOS and Perl Scripting.

Experience in ETL development process using Informatica for Data Warehousing, Data migration and Production support.

Experience in both Waterfall and Agile SDLC methodologies.

Sound knowledge of Relational and Dimensional modeling techniques of Data warehouse (EDS/Data marts) concepts and principles (Kimball/Inmon) – Star/Snowflake schema, SCD, Surrogate keys and Normalization/De-normalization.

Data modeling experience in creating Conceptual, Logical and Physical Data Models using ERwin Data Modeler.

Experience with TOAD, SQL Developer database tools to query, test, modify, analyze data, create indexes, and compare data from different schemas.

Performed the data profiling and analysis making use of Informatica Data Explorer (IDE) and Informatica Data Quality (IDQ).

Worked on Slowly Changing Dimensions (SCD's) Types -1, 2 and 3 to keep track of historical data.

Knowledge in Data Analyzer tools like Informatica Power Exchange (Power Connect) to capture the changed data.

Proficiency in data warehousing techniques for data cleansing, surrogate key assignment and Change data capture (CDC).

Experience in integration of various data sources like Oracle, DB2, Flat Files and XML Files into ODS and good knowledge on Teradata 12.0/13.0, SQL Server 2000/2005/2008 and MS Access 2003/2007.

Expertise in implementing complex business rules by creating re-usable transformations, Mapplets and Mappings.

Hands on experience in MDM development.

Involved in the designing of Landing, Staging and Base tables in Informatica MDM.

Created MDM mapping and configured match and merge rules to integrate the data received from different sources.

Optimized the Solution using various performance-tuning methods (SQL tuning, ETL tuning (i.e. optimal configuration of transformations, Targets, Sources, Mappings and Sessions), Database tuning using Indexes, partitioning, Materialized Views, Procedures and functions).

Extensively used Autosys and Tidal for scheduling the UNIX shell scripts and Informatica workflows.

Extensive knowledge in all areas of Project Life Cycle Development.

Stronganalytical, verbal, written and interpersonal skills.

TECHNICAL SKILLS:

Operating System

UNIX, Linux, Windows

Programming and Scripting

C, C++, Java, Python,.Net, Perl Scripting, Shell Scripting, XSLT, PL/SQL, T-SQL.

Specialist Applications & Software

Informatica Power Center/10.1 10/9.6.1/9.5/9.1/8.6/8.1/7.1, Informatica Power Exchange, Metadata Manager, Informatica Data Quality (IDQ), Informatica Data Explorer (IDE), MDM, SSIS, Salesforce, DataStage, etc.

Data Modeling (working knowledge)

Relational Modeling, Dimensional Modeling (Star Schema, Snow-Flake, FACT, Dimensions), Physical, Logical Data Modeling, and ER Diagrams.

Databases tools

SQL Server Management Studio (2008), Oracle SQL Developer (3.0), Toad 11.6 (Oracle), Teradata, AQT v9 (Advanced query tool) (Oracle/Netezza), DB Artisan 9.0 (Sybase), SQL Browser (Oracle Sybase), Visio, ERWIN

Scheduling tools

Informatica Scheduler, CA Scheduler(Autosys), ESP, Maestro, Control-M.

Conversion/Transformation tools

Informatica Data Transformation, Oxygen XML Editor (ver.9, ver.10)

Software Development Methodology

Agile, Water fall.

Domain Expertise

Publishing, Insurance/Finance, HealthCare

Others (working knowledge on some)

OBIEE RPD creation, OBIEE, ECM, Informatica Data Transformation XMAP, DAC, Rational Clear Case, WS-FTP Pro, DTD.

RDBMS

SQL, SQL*Plus, SQL*Loader, Oracle11g/10g/9i/8i, Teradata, IBM DB2, UDB 8.1/7.0, Sybase 12.5, Netezza v9, MS SQL Server 2000/2005/2008, MS Access 7.0/2000.

PROFESSIONAL EXPERIENCE:

Client: ABBVIE, North Chicago, IL

Role: Sr.Informatica Developer/MDM Consultant Feb 2018 – Till date

Responsibilities:

Involved in gathering and analysis business requirement and writing requirement specification documents and identified data sources and targets.

Worked closely with the Data Integration team to perform validations both on the Informatica MDM hub and Entity 360.

Experience Working with the Address Doctor and its related Cleansing Functions

Experience working in Pharmacy and Providers Data which are coming from different data sources

Worked closely With the Business and PDA Team as the Data Stewards while performing the Match and Merge Tasks

Communicated with business customers to discuss the issues and requirements.

Designed, documented and configured the Informatica MDM Hub to support loading, cleansing of data.

Involved in implementing the Land Process of loading the customer/product Data Set into Informatica MDM from various source systems.

Worked on data cleansing and standardization using the cleanse functions in Informatica MDM.

Developed ETL programs using Informaticato implement the business requirements.

Developed several IDQ complex mappings in Informatica a variety of Power Center, transformations, Mapping Parameters, Mapping Variables, Mapplets& Parameter files in Mapping Designer using Informatica Power Center.

Profiled the data using Informatica Data Explorer (IDE) and performed Proof of Concept for Informatica Data Quality (IDQ)

Used Informatica Power Center to load data from different data sources like xml, flat files and Oracle, Teradata, Salesforce.

Migrated servers from 1and1 to AWS Elastic Cloud (EC2), databases (RDS).

Refactored Java ETL code to provide several new features such as redundancy, error handling, automation, image manipulation (SCALR), and the addition of the AWS Java SDK to handle the transfer of files to S3.

Imported the IDQ address standardized mappings into Informatica Designer as a Mapplets.

Utilized of Informatica IDQ to complete initial data profiling and matching/removing duplicate data

Used relational SQL wherever possible to minimize the data transfer over the network.

Identified and validated the Critical Data Elements in IDQ.

Built several reusable components on IDQ using Standardizers and Reference tables which can be applied directly to standardize and enrich Address information.

Effectively worked in Informatica version based environment and used deployment groups to migrate the objects.

Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations.

Extensively worked on Labeler, Parser, Key Generator, Match, Merge, and Consolidation transformations to identify the duplicate records.

Worked on CDC (Change Data Capture) to implement SCD (Slowly Changing Dimensions) Type 1 and Type 2

Extensively used various active and passive transformations like Filter Transformation, Router Transformation, Expression Transformation, Source Qualifier Transformation, Joiner Transformation, and Look up Transformation, Update Strategy Transformation, Sequence Generator Transformation, and Aggregator Transformation.

Provided support and quality validation through test cases for all stages of Unit and integration testing

Created, Deployed & Scheduled jobs in Tidal scheduler for integration, User acceptance testing and Production region.

Designed workflows with many sessions with decision, assignment task, event wait, and event raise tasks, used informatica scheduler to schedule jobs.

Used the Teradatafast load utilities to load data into tables

Used SQL tools like TOAD to run SQL queries and validate the data.

Converted all the jobs scheduled in Maestro to Autosys scheduler as the per requirements

Worked on maintaining the master data using Informatica MDM

Wrote UNIX Shell Scripts for Informatica Pre-Session, Post-Session and Autosys scripts for scheduling the jobs (work flows)

Performed tuning of queries, targets, sources, mappings, and sessions.

Used Linux scripts and necessary Test Plans to ensure the successful execution of the data loading process

Worked with the Quality Assurance team to build the test cases to perform unit, Integration, functional and performance Testing.

Used EME extensively for version control involved in code reviews, performance tuning strategies at ab initio and Database level.

Prepared the error handling document to maintain the error handling process and created test cases for the mappings developed then created the integration testing document.

Provided Knowledge Transfer to the end users and created extensive documentation on the design, development, implementation, daily loads, and process flow of the mappings

Provided 24x7 production supports for business users and documented problems and solutions for running the workflows.

Environment:Informatica Power Center 10.1, UNIX, SQL, IDQ, IDE, CDC, MDM,Java, Linux, Perl, AWS,WINSCP, Shell, PL/SQL, Netezza, Teradata, Collibra, Microsoft SQL Server 2008, and Microsoft Visual studio.

Client: CISCO,Santa Clara, CA

Role: Sr. Informatica Developer / Analyst Feb 2017 – Jan2018

Responsibilities:

Involved in all phases of SDLC from requirement gathering, design, development, testing, Production, and support for production environment.

Defined, configured, and optimized various MDM processes including landing, staging, base objects, foreign-key relationships, lookups, query groups, queries/custom queries, cleanse functions, batch groups and packages using Informatica MDM Hub console.

Used Informatica Power Center for (ETL) extraction, transformation and loading data from heterogeneous source systems into target database.

Involved in extracting the data from the Flat Files and Relational databases into staging area.

Created Stored Procedures for data transformation purpose.

Involved in the Dimensional Data Modeling and populating the business rules using mappings into the Repository for Data management

Worked on Informatica Power Center 9 x tools – Source Analyzer, Data warehousing designer, Mapping, Designer, Mapplet& Transformations.

Used Informatica power center and Data quality transformations - Source qualifier, expression, joiner, filter, router, update strategy, union, sorter, aggregator and normalizer, Standardizer, Labeler, Parser, Address Validator (Address Doctor), Match, Merge, Consolidation transformations to extract, transform, cleanse, and load the data from different sources into DB2, Oracle, Teradata, Netezza and SQL Server targets.

Created and configured workflows, worklets & Sessions to transport the data to target warehouse Oracle tables using Informatica Workflow Manager.

Worked on Database migration from Teradata legacy system to Netezza and Hadoop.

Worked in building Data Integration and Workflow Solutions and Extract, Transform, and Load (ETL) solutions for data warehousing using SQL Server Integration Service (SSIS).

Used Teradata Utilities (BTEQ, Multi-Load, and Fast-Load) to maintain the database.

Worked with different scheduling tools like Tidal, Tivoli, Control M, Autosys.

Created Tivoli Maestro jobs to schedule Informatica Workflows.

Built a re-usable staging area in Teradata for loading data from multiple source systems using template tables for profiling and cleansing in IDQ

Created profile and scorecards to review data quality.

Actively involved in Data validations and unit testing to make sure data is clean and standardized before loading in to MDM landing tables.

Actively involved in Exceptional handling process in IDQ Exceptional transformation after loading the data in MDM and notify the Data Stewards with all exceptions.

Worked on Autosys as job scheduler and used to run the created application and respective workflow in this job scheduler in selected recursive timings.

Generated PL/SQL and Shell scripts for scheduling periodic load processes.

Designed and developed UNIX scripts for creating, dropping tables which are used for scheduling the jobs.

Invoked Informatica using "pmcmd" utility from the UNIX script.

Wrote pre-session shell scripts to check session mode (enable/disable) before running/ schedule batches.

Involved in supporting 24*7 rotation system and strong grip in using scheduling tool Tivoli.

Involved in Production support activities like batch monitoring process in UNIX

Prepared Unit test case documents

Environment: Informatica Power Center 9.6.1, UNIX, Oracle, Linux, Perl, Shell, MDM, IDQ, PL/SQL, Tivoli, Oracle 11g/10g, Teradata 14.0.

Client: Mc Graw Hill, Columbus OH

Role: Sr. ETL Developer / Analyst Mar 2016 - Feb 2017

Responsibilities:

Worked with Business Analysts (BA) to analyze the Data Quality issue and find the root cause for the problem with the proper solution to fix the issue...

Document the process that resolves the issue which involves analysis, design, construction and testing for Data quality issues

Involved in doing the Data model changes and other changes in the Transformation logic in the existing Mappings according to the Business requirements for the Incremental Fixes

Worked extensively with Informatica tools like Source Analyzer, Warehouse Designer, Transformation Developer, and Mapping Designer.

Extensively used Informatica Data Explorer (IDE)& Informatica Data Quality (IDQ) profiling capabilities to profile various sources, generate score cards, create and validate rules and provided data for business analysts for creating the rules.

Created Informatica workflows and IDQ mappings for - Batch and Real Time.

Extracted data from various heterogeneous sources like DB2, Sales force, Mainframes, Teradata, and Flat Files using Informatica Power center and loaded data in target database.

Created and Configured Landing Tables, Staging Tables, Base Objects, Foreign key relationships, Queries, Query Groups etc. in MDM.

Defined the Match and Merge Rules in MDM Hub by creating Match Strategy, Match columns and rules for maintaining Data Quality

Extensively worked with different transformations such as Expression, Aggregator, Sorter, Joiner, Router, Filter, and Union in developing the mappings to migrate the data from source to target.

Used connected and Unconnected Lookup transformations and Lookup Caches in looking the data from relational and Flat Files. Used Update Strategy transformation extensively with DD_INSERT, DD_UPDATE, DD_REJECT, and DD_DELETE.

Extensively Implemented SCD TYPE 2 Mappings for CDC (Change data capture) in EDW.

Involved in doing Unit Testing, Integration Testing, and Data Validation.

Migration of Informatica maps extensively involved in migration from Dev to SIT and UAT to Production environment.

Developed Unix script to sftp, archive, cleanse and process many flat files

Created and ran Pre-existing and debug sessions in the Debugger to monitor and test the sessions prior to their normal run in the Workflow Manager

Extensively worked in migrating the mappings, worklets and workflows within the repository from one folder to another folder as well as among the different repositories.

Created Mapping parameters and Variables and written parameter files.

Used SQL queries and database programming using PL/SQL (writing Packages, Stored Procedures/Functions, and Database Triggers).

Worked on Scheduling Jobs and monitoring them through Control M and CA scheduler tool(Autosys).

Used SQL tools like TOAD to run SQL queries and validate the data in warehouse.

Worked with the SCM code management tool to move the code to Production

Extensively worked with session logs and workflow logs in doing Error Handling and trouble shooting.

Environment:Informatica Power Center 9.0.1, Erwin, Teradata, Tidal, SQL Assistance, DB2, XML, Oracle 9i/10g/11g, MQ Series, OBIEE 10.1.3.2, IDQ, MDM Toad and UNIX Shell Scripts.

Client: BBVA Compass Bank, Birmingham, AL Nov2014 – Mar2016

Role: Sr. Informatica Developer/IDQ/MDM

Responsibilities:

Designing the dimensional model and data load process using SCD Type 2 for the quarterly membership reporting purposes.

Derived the dimensions and facts for the given data and loaded them on a regular interval as per the business requirement.

Generating the data feeds from analytical warehouse using required ETL logic to handle data transformations and business constraints while loading from source to target layout.

Worked on Master Data Management (MDM), Hub Development, extract, transform, cleansing, loading the data onto the staging and base object tables

Extracted data from multiple sources such as Oracle, XML, and Flat Files and loaded the transformed data into targets in Oracle, Flat Files.

Wrote Shell Scripts for Data loading and DDL Scripts.

Worked with Informatica Data Quality (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ

Designing and coding the automated balancing process for the feeds that goes out from data warehouse.

Implement the automated balancing and control process which will enable the control on the audit and balance and control for the ETL code.

Improving the database access performance by tuning the DB access methods like creating partitions, using SQL hints, and using proper indexes.

All the jobs are integrated using complex Mappings including Mapplets and Workflows using Informatica power center designer and workflow manager.

Worked on data cleansing and standardization using the cleanse functions in Informatica MDM.

Created ETL mappings, sessions, workflows by extracting data from MDM system, FLASH DC & REM source systems.

Designed and created complex source to target mappings using various transformations inclusive of but not limited to Aggregator, Look Up, Joiner, Source Qualifier, Expression, Sequence Generator, and Router Transformations.

Mapped client processes/databases/data sources/reporting software to HPE’s XIX X12 processing systems(BizTalk/Visual Studio/Oracle SQL/MS SQL/C#/.Net/WSDL/SOAP/Rest/API/XML/XSLT).

Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations, and create mapplets that provides reusability in mappings.

Analyzing the impact and required changes to incorporate the standards in the existing data warehousing design.

Following the PDLC process to move the code across the environments though proper approvals and source control environments.

Source control using SCM.

Environment:Informatica Power Center 9.0.1, Erwin 7.2/4.5, Business Objects XI, Unix Shell Scripting, XML, Oracle 11g/10g, DB2 8.0, IDQ, MDM, TOAD, MS Excel, Flat Files, SQL Server 2008/2005, PL/SQL, Windows NT 4.0.

Client: Infinite Computer Solutions – AMDOCS, (Offshore - Bangalore, IN) (Onsite – Rockville, MD)

Role: ETL Developer / Analyst Mar 2012 – Oct 2014

Responsibilities:

Involved in the requirement definition and analysis support for Data warehouse efforts.

Documented and translated user requirements into system solutions; developed implementation plan and schedule.

Designed fact and dimension tables for Star Schema to develop the Data warehouse.

Extracted the data from Teradata, SQL Server, Oracle, Files, and Access into Data warehouse.

Created dimensions and facts in physical data model using ERWIN tool.

Used Informatica Designer to create complex mappings using different transformations to move data to a Data Warehouse

Developed mappings in Informatica to load the data from various sources into the Data Warehouse, using different transformations like Source Qualifier, Look up, Aggregator, Stored Procedure, Update Strategy, Joiner, Filter.

Scheduling the sessions to extract, transform and load data into warehouse database on Business requirements.

Loaded the flat files data using Informatica to data warehouse

Created Global Repository, Groups, Users assigned privileges Using Repository manager.

Setting up Batches and sessions to schedule the loads at required frequency using Power Center Server Manager.

Handled common data warehousing problems like tracking dimension change using SCD type2 mapping.

Used e-mail task for on success and on-failure notification.

Used decision task for running different tasks in the same workflow.

Assisted team member with their various Informatica needs.

Developed and maintained technical documentation regarding the extract, transformation, and load process.

Responsible for the development of system test plans, test case creation, monitoring progress of specific testing activities against plan, and successfully completing testing activities within the requisite project timeframes.

Environment:Informatica Power Center 8.1, Erwin, Oracle 9i, UNIX, Sybase, MS SQL Server Windows 2000.

Client: Cybage,Pune,India

Role: Informatica Developer Sep 2010 – Feb 2012

Responsibilities:

Involved in analysis, design, development, test data preparation, unit and integration testing, Preparation of Test cases and Test Results

Coordinating with client, Business and ETL team on development

Developed Batch jobs using extraction programs using COBOL, JCL, VSAM, Datasets, FTP to Load Informatica tables

Involved in full project life cycle - from analysis to production implementation and support with emphasis on identifying the source and source data validation, developing logic, and transformation as per the requirement and creating mappings and loading the data into BI database.

Based on the business requirements created Functional design documents and Technical design specification documents for ETL Process.

Designing and developing ETL solutions in Informatica Power Center 8.1

Designing ETL process and creation of ETL design and system design documents.

Developing code to extract, transform, and load (ETL) data from inbound flat files and various databases into various outbound files using complex business logic.

Most of the transformations were used like Source Qualifier, Aggregator, Filter, Expression, and Unconnected and connected Lookups, Update Strategy.

Created automated shell scripts to transfer files among servers using FTP, SFTP protocols and download files.

Developed Informatica mappings, enabling the ETL process for large volumes of data into target tables.

Designed and developed process to handle high volumes of data and high volumes of data loading in each SLA.

Created Workflow, Worklets and Tasks to schedule the loads at required frequency using Informatica scheduling tool.

Ensured acceptable performance of the data warehouse processes by monitoring, researching and identifying the root causes of bottlenecks.

Acted as a liaison between the application testing team and development team in order to make timely fixes.

Environment:Informatica Power Center 8.1, ETL, Business Objects, Oracle 10g/9i/8i, HP - Unix, PL/SQL.

EDUCATION DETAILS:

Bachelor’s Degree in Electronic and communication. Passed out in year 2009 from JNTU Hyderabad



Contact this candidate