Data Assistant

Location:

Posted:

December 20, 2016

Resume:

PROFESSIONAL SUMMARY

Around * years of experience in Teradata/Informatica. Expertise in loading and extracting data from Teradata using various utilities like Teradata SQL Assistant, BTEQ, MULTILOAD, FASTLOAD, FASTEXPORT, TPUMP and Teradata Parallel Transporter.

Experienced in writing Teradata SQL scripts for transforming business rules.

Experienced in extracting/transforming data from various relational database management systems.

Proficient in monitoring and understating the step by step processing of very big queries via Teradata Viewpoint.

Expertise in handling Terabytes of databases and effectively running the queries against such databases with no performance issues.

Strong proficiency in writing SQL (including ORACLE and Teradata).

Expertise in developing summaries and reports using Advanced Teradata SQL according to business needs.

Expertise in understanding the business requirements and converting them into Technical specifications and reverse engineering the existing systems or processes for documenting and bug fixing.

Experience in performance tuning of large scale databases using Views, Indexing mechanism, Global Temporary tables and Volatile tables in TERADATA and moving the Oracle table’s data to Teradata using Teradata Parallel Transporter (TPT).

Good exposure to multiple flavors of UNIX like MP-RAS, SUN SOLARIS, IBM AIX, HP-UX and code repositories like Harvest, StarTeam, Clear Case.

Good exposure to Internet Marketing, Health Care domain, understanding of the clinical business rules, Telecom Domain and acquired Client appreciations.

Expertise in developing the Batch control processes in UNIX.

Involved in generating Mload and Tpump scripts to load the data into Teradata table.

Experienced with Rest Architecture and worked on JSON, XML and SOAP.

Good exposure to NoSQL database like Cassandra, MongoDB.

Expertise in Oracle Stored Procedures, Triggers, Index, Table Partitions and experienced in Loading data like Flat Files, XML Files, Oracle, DB2, SQL Server into Data Warehouse/Data Marts using Informatica.

Strong experience with ETL tool Informatica 9.6/8.1/7.1/6.2.

Have good knowledge on Linux 5.4 essentials

Created mapping documents and work flows and data dictionaries.

Experienced in developing business reports by writing complex SQL queries using views, macros, volatile and global temporary tables.

Extensive Knowledge of RDBMS concepts, PL/SQL, Stored procedure and normal forms.

Quick adaptability to new technologies and zeal to improve technical skills.

Good analytical, programming, problem solving and troubleshooting skills.

Good knowledge on major components in Hadoop Ecosystem like Hadoop Map Reduce, HDFS, HIVE, PIG, Pentaho, HBase, Zookeeper, Sqoop, Oozie, Cassandra, Amazon Dynamo DB, Kafka, Storm, Flume, Spark and Avro.

TECHNICAL SKILLS

Operating Systems

UNIX, Windows.

Database

Teradata, SQL, Oracle.

Languages

Teradata SQL, PL/SQL, Shell Scripting

Teradata Utilities

Teradata - Mload, FastLoad, BTEQ, Fast Export, Tpump, and TPT

Teradata Tools

Teradata SQL Assistant, Teradata Manager

ETL tools

Informatica Power centre 9.0, 9.1, 9.5

Process/Methodologies

Waterfall Methodology, Agile Methodology, FSLDM

Modeling Tools

Visio and Erwin

PROFESSIONAL EXPERIENCE

AT&T, Atlanta, GA Sept 2016-Till Date

Senior Teradata Developer

Responsibilities:

•Involved in complete Software Development Life-Cycle (SDLC) including requirements gathering, analysis, design, development, testing, implementation, and deployment.

•Converted the Business and Functional requirements into High and low level design documents.

•Worked with various system interfaces to gather requirements for migration and implementation.

•Developed Shell Scripts for automating end to end testing.

•Worked on the Teradata stored procedures and functions to confirm the data and have load it on the table.

•Fine-tuning to the existing scripts and process to achieve increased performance and reduced load times for faster user query performance.

•Done the impact assessment in terms of schedule changes, dependency impact, and code change requests on the existing data warehouse applications that running in a production environment.

•Provided quick production fixes and proactively involved in fixing production support issues.

•Encrypting the reports and setting up SFTP interface so that the users can download and automate the process of downloading instead of manual downloading.

•Created stored procedure that will update the script path in order to migrate the processes to new model.

•Preparing the test cases and performing unit test cases.

•Proficient working with Unix/Linux environments and writing UNIX shell scripts, Java Sybase

•Reviewing on Design documents, Unit and Integration test cases.

•Involved in code reviews prepared by the team.

•Co-ordination and Collaboration with offshore and onsite teams.

•Analyze and recommend solutions for data issues.

•Created Hive queries that helped market analysis spot emerging trends by comparing fresh data with

•EDW reference tables and historical metrics.

•Managed and reviewed Hadoop log files.

•Developed PL/SQL and UNIX Shell Scripts using VI editor.

•Tested raw data and executed performance scripts.

•Supported code/design analysis, strategy development and project planning.

Environment: Teradata T14/T13 SQL Assistant, BTEQ, Fast Load, MultiLoad, PL/SQL, Fast Export,Informatica, Putty, UNIX.

Charles Schwab Corporation, GA Nov 2015- Aug 2016

Senior Teradata Developer

Responsibilities:

•Involved in Requirement gathering, business Analysis, Design and Development, testing and implementation of business rules.

•Translate customer requirements into formal requirements and design documents.

•Development of scripts for loading the data into the base tables in EDW using FastLoad, MultiLoad and BTEQ utilities of Teradata.

•Writing MultiLoad scripts, FastLoad and Bteq scripts for loading the data into stage tables and then process into BID.

•Developed Scripts to load the data from source to staging and staging area to target tables using different load utilities like Bteq, FastLoad and MultiLoad.

•Writing scripts for data cleansing, data validation, data transformation for the data coming from different source systems.

•Developed mappings in Informatica to load the data from various sources using different transformations like Look up (connected and unconnected), Normalizer, Expression, Aggregate, Update Strategy, Sequence Generator, Joiner, Filter, Update Strategy, Rank and Router transformations.

•Developing and reviewing Detail Design Document and Technical specification docs for end to end ETL process flow for each source systems.

•Involved in Unit Testing and Preparing test cases.

•Modification of views on Databases, Performance Tuning and Workload Management.

•Performed application level DBA activities creating tables, indexes, monitored and tuned Teradata BTEQ scripts using Teradata.

•Extracted data from various source systems like Oracle, SQL Server and flat files as per the requirements.

•Worked on Teradata Multi-Load, Teradata Fast-Load utility to load data from Oracle and SQL Server to Teradata.

•Query Analysis using Explain for unnecessary product joins, confidence factor, join type, order in which the tables are joined.

•Collected Multi-Column Statistics on all the non-indexed columns used during the join operations & all columns used in the residual conditions.

•Used extensively Derived Tables, Volatile Table and GTT tables in many of the ETL scripts.

•Tuning of Teradata SQL statements using Explain analyzing the data distribution among AMPs and index usage, collect statistics, definition of indexes, revision of correlated sub queries, usage of Hash functions, etc…

Environment:

Teradata 14, Teradata SQL Assistant, UNIX, Informatica 9x,BTEQ, MLOAD, TPUMP, FAST LOAD, FAST EXPORT, TPT.

Teradata Developer Jul 2014 – Oct 2015

IBM India Pvt ltd.

DBS (The Development Bank of Singapore) is a Singaporean multinational banking and financial services company.DBS Bank is the largest bank in South East Asia.It has market-dominant positions in consumer banking, treasury and markets, asset management, securities brokerage, equity and debt fund-raising in Singapore and Hong Kong.The main aim of this project is to load data coming from different source system like Mainframes Db2,open system etc. Based on user requirement we develop scripts (Bteq, M load, TPT)and load the data into target date mart. we used Informatica to extract the required data from various sources like Relational files and validate the data and load into the Relational database (Staging area)Teradata and Transform the data accordingly and load into the centralized warehouse by using the Teradata Utilities.

Responsibilities:

•Responsible for coordinating with the Business System Analysts in the requirement gathering process and creating technical specific document. Gathering requirements from the various systems business users.

•Fixed issues with the existing Fast Load/ Multi Load Scripts in for smooth loading of data in the warehouse more effectively.

•Worked on loading of data from several flat files sources to Staging using MLOAD, FLOAD.

•Created Bteq scripts with data transformations for loading the base tables.

• Worked on optimizing and tuning the Teradata SQL to improve the performance of batch and response time of data for users.

•Extensively worked on Informatica to extract data from flat files and Oracle, and to load the data into the Teradata

•Created ETL Scripts & Procedures to extract data and populate the data warehouse using Oracle Gateway to Teradata

•Fast Export utility to extract large volume of data and send files to downstream applications.

•Provided performance tuning and physical and logical database design support in projects for Teradata systems and managed user level access rights through the roles.

•Developed T-Pump scripts to load low volume data into Teradata RDBMS at near real-time.

•Created BTEQ scripts to load data from Teradata Staging area to Teradata

•Performed tuning of Queries for optimum performance.

•Preparation of Test data for Unit testing and data validation tests to confirm the transformation logic

•Tuned various queries by COLLECT STATISTICS on columns in the WHERE and JOIN expressions.

•Performance tuning for Teradata SQL statements using Teradata EXPLAIN Collected statistics periodically on tables to improve system performance.

•Instrumental in Team discussions, Mentoring and Knowledge Transfer.

•Responsible for Implementation & Post Implementation support

•Documentation of scripts, specifications, and other processes.

Environment:

Teradata SQL Assistant, Informatica, Teradata Utilities (Fast Load, Multi Load, Fast Export, SQL Assistant, Bteq, TPT), Control-M, UNIX, FTP.

Accel Frontline, India Jan 2012 - Jun 2013

Teradata Developer

The project involved in migrating data from source systems to the EDW (Enterprise Data Warehouse). This process includes extraction of data from source systems, applying transformations and loading the data after the query tuning and performance check. These Processes are scheduled to run daily, weekly, or monthly. Teradata SQL and Client Utilities have played a significant role in migrating the data to Data warehouse and achieving the expected gains.

Responsibilities:

•Development of scripts for loading the data into the base tables in EDW using FastLoad, MultiLoad and BTEQ utilities of Teradata.

•Writing MultiLoad scripts, FastLoad and Bteq scripts for loading the data into stage tables and then process into BID.

•Developed Scripts to load the data from source to staging and staging area to target tables using different load utilities like Bteq, FastLoad and MultiLoad.

•Writing scripts for data cleansing, data validation, data transformation for the data coming from different source systems.

•Used Informatica designer to create complex mappings using different transformations to move data to a Data Warehouse.

•Involved in Unit Testing and Preparing test cases.

•Modification of views on Databases, Performance Tuning and Workload Management.

•Reviewed the SQL for missing joins & join constraints, data format issues, mis-matched aliases, casting errors.

•Query Analysis using Explain for unnecessary product joins, confidence factor, join type, order in which the tables are joined.

•Collected Multi-Column Statistics on all the non-indexed columns used during the join operations & all columns used in the residual conditions.

Environment:

Teradata 14, Teradata SQL Assistant, MLOAD, FASTLOAD, BTEQ, TPUMP, UNIX Shell Scripting, Windows XP.

EDUCATION:

Bachelor of Technology in Computer Science and Engineering.

CERTIFICATION:

Teradata 14 Certified Professional.

Contact this candidate