Post Job Free

Resume

Sign in

IBM DataStage, Unix Shell Scripting, Autosys, SQL, DB2

Location:
McLean, VA
Posted:
November 02, 2017

Contact this candidate

Resume:

VENU KUMAR

ETL DataStage Developer

Cell Phone: 857-***-****

Email – ac23wg@r.postjobfree.com

SUMMARY:

5+ years of IT experience in all project phases (SDLC)including planning, design and development, testing, production role out, support and maintenance

Senior ETL developer (IBM DataStage 11.x/9.x/8.x/7.x) for projects including Data conversion, Data migration, Data integration, Data warehousing, Data marts and standalone reporting.

Experience with Data warehouse development, extraction, transformation, data cleansing (Quality stage) migration, Data Analysis and data validation,

Strong knowledge and experience SDLC methodologies including Agile, Waterfall etc.

Extensive experience in implementation of Star, Snowflake schemas and multi-dimensional modeling

Ability to interact with business users, reporting team to coordinate work, gathers requirements and design work plan.

Extensive experience in data analysis, Data profiling and SQL development.

Experience in leading and developing Extract Transform Load (ETL) process including direct loads, incremental loads, SCD (slowly changing dimensions) loads etc.

Extensive experience in Quality stage projects for data cleansing, data standardization, data validation (Name and Address standardization, US postal address verification, Geo coding etc.

Experience with tuning DataStage jobs using various techniques by understanding its complexion during volume testing before moving to production. This included tuning SQL in database levels, using hashed file for faster processing of lookups, breaking big jobs into smaller units etc. as per the requirement and need etc.

Ability to troubleshoot errors related to database and DataStage, warnings and failures and performance tuning of existing jobs.

Proficient in using most of the DS/QS stages

Vast experience in Oracle, SQL Server, Netezza, DB2 database and applications including SQL and stored procedures.

Created ETL and SQL based ad hoc reports based on the requirements from various groups.

Engaged in unit testing (during job designs), end to end ETL module testing, volume testing designing SQL test cases etc.

Planned DataStage processes to effectively develop by creating Shared Containers (reusability of code)

Troubleshoot issues related job failures or defects, resolve by change management and any tuning necessary.

Experience in working with Data Modeling, Business teams and PMs to address issues relating to load process, data constraints and data integrity issues. Working on Load order of Relational tables and define, design code and crosswalk tables as needed.

Experience in Code promotion in various environments by import, export of job designs, parameter manipulation, version control etc.

Experienced in creating Data Warehousing and conversion projects Test Plans, Test Objectives, Test Strategies, and Test Cases. Ensuring the Data in data warehouse meets the business requirements.

Highly proficient in interacting with business users to identify information needs and initiating process changes, gathering requirements, designing workflow using MS Visio.

Experience in problem analysis / system analysis and technical problem resolutions relating to BI data including ETL and Reporting data.

Strong communication and client/customer facing skills.

TECHNICAL SKILLS:

ETL Tools : DataStage Quality stage 11.x/9.x/8.x/7.x Administrator, Designer, Director, and SSIS (Knowledge)

Workflow Tools : MS-Visio, MS-Access, MS Excel, Rational Tools

Methodologies : Waterfall, Agile/SCRUM,

Operating Systems : Windows 98/2000/XP/7, Windows NT 4.0, SUN Solaris 8/9/10, HP-UX 10.x/11.x and IBM AIX 4.0. Unix

Databases : DB2, Oracle /8i/9i, SQL Server 2005.2008, 2012

Languages : PL/SQL, SQL, Unix Shell Scripting

Database Tools : :SQL Plus, SQL Loader, TOAD, Rapid SQL,

SQL Server Management Studio

Scheduling Tools : Control M, Autosys

PROFESSIONAL EXPERIENCE:

Client: Freddie Mac

ETL Developer

McLean, VA

May 2017 – Present

Responsibilities:

Worked in the upgrade project which involves designing new ETL jobs. Also, involved in design changes to the existing DataStage jobs to improve the overall performance and make those compatible with the latest version of the ETL tool.

Designed and developed ETL processes using DataStage designer to load data from Oracle, Sybase, and Flat Files (Fixed Width) to staging database and from staging to the target Data Warehouse database.

Extensively worked on Unix Shell Scripting from modifying the existing shell scripts

writing new scripts.

Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions.

Used DataStage stages namely Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Lookup, Remove Duplicates, Change Capture, Funnel, Peek, Column Import, Stored Procedure, ODBC Connector, and SFTP stages in accomplishing the ETL Coding.

Also worked extensively with some custom stages owned by Freddie Mac.

Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis

Excessively used DS Director for monitoring Job logs to resolve issues.

Created and tested Autosys jobs as part of the end-to-end testing.

Designed the mappings between the source tables and target tables.

Environment: AIX, Unix, Rapid SQL, IBM DataStage 11.5/8.5, SQL, Autosys, DB2, VMWare.

Client: Dealer Track

IBM DataStage Developer

Lake Success, New York

June 2015 - Till date

Responsibilities:

Involved in design and development of ETL processes for data warehousing.

Coordinating with Architects, Business users, DBAs to resolve any resolve any issues related to data mismatches, integrity constraints and load orders.

Tuned DataStage jobs for performance by working with DBA and SQL coding, design changes within the job.

Design and development of DataStage parallel jobs from direct loads, incremental loads to data transformations with complex logics.

Created Load process jobs including direct loads, incremental loads and SCD (slowly changing dimensions) loads (Type 1 and Type 2).

Performed extensive data manipulations using various stages like Aggregator, Lookup, Join, Merge, Remove Duplicates, Link collector, Transformer Stages along with built-in transformations, Functions, Stage variables.

Extensively worked in Quality stage projects for data cleansing, Address verification, data investigation, Name and Address standardization.

Worked with business users to gather requirements for data conversion activities and design.

Designed DataStage and Quality stage jobs as per the mappings between sources and targets in various conversation, data integration projects.

Experience using the CDC Tool and CDC within the Information Server Platform.

Design jobs to load data into staging, intermediate and targets in data warehouses and marts by using direct loads, incremental loads, Type 2 SCD as necessary.

Develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database and enforcing data Integrity and business rules.

Automated loads by designing job sequencers and scheduling the loads as required.

Troubleshoot production issues with job log review, making necessary changes in design if necessary via change management and code promotion process.

Worked with information analyzer for performing data analysis, profiling etc.

Environment: Unix, Oracle 11 g, DB2, Application Life Cycle Management, IBM DataStage 11.5/8.5

Client: Cigna

Senior ETL DataStage Developer

Hartford, CT

Dec 2013– May 2015

Responsibilities:

Worked in a team with ETL developers (DataStage and Quality stage) and process analyst in preparing the requirements and writing workflows and process flows.

Created job controls to set up sequences of job depending on the business requirements.

Loaded data to Data marts after extracting it from various sources and making required transformations.

Worked with end users and report developers for making changes to the existing jobs.

Performed extensive data manipulations using various stages like Aggregator, Lookup, Join, Merge, Remove Duplicates, Link collector Transformer Stages along with build-in transformations, Functions, Stage variables.

Designed and Coded the mappings between sources and targets.

Develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database and enforcing data Integrity and Business Rules.

Created Load process jobs including direct loads, incremental loads and SCD (slowly changing dimensions) loads (Type 1 and Type 2).

Written complex queries to facilitate the supply of data to other teams.

Tuned DataStage jobs by breaking single job into multiple jobs, using Hashed files for lookups, tuning SQL queries in database level and within DataStage as required.

Used DataStage Manager/Director (in version 8) to Import/Export DS files.

Created Job control for sequencing the build jobs.

Worked with Version control for maintaining changes in the existing DS jobs.

Environment: Data stage version 7.5, Quality Center, UNIX, Toad, Autosys, DB2, Oracle.

Client: Verizon

ETL Consultant

Oct 2012 – Nov 2013

Colorado Springs, CO

Responsibilities:

Developed guidelines and procedures governing enterprise-wide data collection.

Developed DataStage and Quality Stage jobs (Server and parallel).

Developed processes for cleansing, transforming, extracting, integrating and loading data using DataStage.

Wrote complex queries to facilitate the supply of data to other teams.

Performed tuning of slowly running DataStage jobs by tuning the SQL queries in Database and or modifying the stages in DataStage as required.

Worked with Quality stage for data cleansing (address standardization etc.)

Designed Quality Stage jobs for customer data, used investigator job for analyzing customer information, generating reports on the data.

Defined the matching cut offs and survivor rules as per the business requirements in Quality stage jobs.

Used DataStage manager/Director (in version 8) to import export DS files.

Created Load process including direct loads, incremental loads and SCD (slowly changing dimensions) loads (Type 1 and Type 2).

Worked with Version control for maintaining changes in the existing DS jobs.

Performed extensive data manipulations using various stages like Aggregator, Lookup, Join, Merge, Remove Duplicates, Link collector, Join, Merge, Transformer Stages along with, build-in transformations, functions, Stage Variables etc.

Maintained and managed Metadata for enterprise systems, incorporating user input.

Worked on design documentation for exporting DS to version 8 and all ETL processes.

Developed and implemented data naming conventions and documentation for enterprise system.

Validated data to ensure the quality, validity and accuracy of content.

Designed the mappings between sources and targets and developed ETL jobs.

Worked on DB2, Teradata, SQL SERVER and Oracle databases for importing and exporting data.

Environment: IBM DataStage 7.5, HP ALM, Windows 2000/XP, Teradata, Oracle 9i 10g, Business Objects, UNIX, SQL Server, Quality stage.

EDUCATION:

Bachelor of Technology in Computer Science from Jawaharlal Nehru Technological University, Hyderabad, India



Contact this candidate