Post Job Free

Resume

Sign in

ETL Developer

Location:
North Brunswick, NJ
Posted:
October 19, 2020

Contact this candidate

Resume:

SHILPI JAIN

SUMMARY:

*+ years IT experience in Design, Development, Maintenance, Enhancements and Production Support of which includes Data warehousing and Health Care applications using SQL Server & BI tools like Talend (DI, Big Data), SAS & Tableau.

IT Experience in Pharma & Healthcare industry (Walgreens) & Insurance Industry (AXA).

Experience in adhering software methodologies like Waterfall and Agile.

Design, development & analysis of the SQL server & Business Intelligence tools.

Created tables & queries to define & manipulate data.

Prepared technical design documents for enhancements and maintenance releases.

Extensive experience in ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and Loading using Talend and designed data conversions from wide variety of source systems including SAS, SQL server 14, Teradata and non - relational sources like flat files, CSV & XML files.

Expertise in creating mappings in TALEND using tMap, tJoin, tReplicate, tParallelize, tConvertType, tflowtoIterate, tAggregate, tSortRow, tFlowMeter, tLogCatcher, tRowGenerator, tNormalize, tDenormalize, tSetGlobalVar, tmap, treplicate, tJava, tJavarow, tAggregateRow, tWarn, tLogCatcher, tMysqlScd, tFilter, tGlobalmap, tDie etc.

Created Talend ETL jobs to receive attachment files from pop e-mail using tPop, tFileList and tFileInputMail and then loaded data from attachments into the database and achieved the files.

Knowledge of Data modeling techniques like Data Modeling- Dimensional/ Star Schema and Snowflake modeling.

Self-Starter and Team Player with excellent communication, organizational and interpersonal skills with the ability to grasp things quickly.

TECHNICAL SKILLS:

ETL Tools: Talend Open Studio, Talend DI, SAS

Database: SQL Server, DB2, Teradata

Environment: WINDOWS, Unix, Linux

Languages: SQL, UNIX, Java,C

Reporting Tools: Tableau, MS Office Suite

Other Tools/Utilities: TAC, Putty, WinScp, Filezilla, Teradata Assistant, VM ware workstation

PROFESSIONAL EXPERIENCE:

Walgreens, Chicago, IL May 2019 - Till Date

ETL - Talend Developer

As a developer, the objective of the project was to migrate the code from SAS to Talend DI environment. To convert the SAS code into Talend jobs and compare both the outputs. Output from both the methods should match.

Responsibilities

Translated business rules and functionality requirements into ETL procedures. Developed ETL procedures and data mappings to ensure conformity, compliance with standards and lack of redundancy.

Created technical documents for ETL design and jobs infrastructure using Talend Open Studio.

Worked on the design, development and testing of Talend mappings.

Experience of working on development as well as migration of projects from SAS to Talend.

Created jobs to pass parameters from child job to parent job and Importing and exporting of jobs to SVN repository.

Worked on Talend components like tReplace, tmap, tsort, tFilterColumn, tFilterRow, tJava, Tjavarow, tConvertType tFileCopy, tFileCompare, tFileExist, TFileDelete, & tFileRename etc.

Used Database components like tMSSQLInput, tMsSqlRow, tMsSqlOutput, tOracleOutput, tOracleInput etc.

Developed project specific Deployment job responsible to deploy Talend jar files on to the windows environment as a zip file, later, this zip file is unzipped, and the files are again deployed to the Unix box.

Worked on improving the performance of Talend jobs by minimizing the number of jobs runs and execution time.

Created triggers for a Talend job to run automatically on server.

Implemented update strategy on tables and used tJava, tJavarow components to read data from tables to pull only newly inserted data from source tables.

Monitored the daily runs, weekly runs and adhoc runs to load data into the target systems.

Created & modified the ETL processes to achieve the daily/monthly requirements.

Worked closely with the QA team, to identify the bugs, made changes accordingly.

Debugged issues and deployed code versions in Talend.

Got Client appreciation for timely and bug free delivery of the given requirement.

Environment: Talend DI, SAS, SQL, Tableau, Agile

AXA, New York City, NY / Delhi, India Jan 2016 - Mar 2019

ETL - Talend Developer

As a BI developer, performed ETL processes on raw data collecting from different sources and maintained a database and data warehouse. Developed jobs in Talend from stage to source, intermediate, conversion and target.

Responsibilities

Participated with extensive involvement in all the phases of development lifecycle involving definition, design meetings, functional and technical walkthroughs.

Extensively involved in gathering business requirements as an endeavor that will facilitate the planning and implementation phase of a data warehouse / data mart.

Created business requirement document, technical design & testing documents.

Extract, Transfer and Load the data from different data sources like flat files, DB2, SQL or Oracle servers, and excel to the data mart using Talend DI.

Created and managed Source to Target mapping documents for all Facts and Dimension tables.

Developed the requirement end to end by creating Talend jobs including master jobs.

Deployed the master job in the staging environment using Filezilla, Winscp & Putty.

Working with other development team members to analyze database & system integration changes for the project.

Performed Unit testing, Integration testing & system testing for the given requirement.

Troubleshoot long running jobs and fixing the issues.

Created Reports using Tableau for better data analysis.

Involved in deployment activities, creation of the deployment guide for migration of the code.

Environment: Talend DI, SQL, Tableau

Intas Pharmaceuticals, Ahmedabad, India July 2013 - May 2015

SQL Developer

The main goal of the project was to create the summarized reports with data obtained as an excel file from a data provider from source. The data were to be cleansed, extracted, transformed and loaded into the destination using SQL. The data were analyzed and finally reports were generated for this data.

Responsibilities

Design and develop the relational database and implement it using SQL.

Monitored and tuned database resources and activities for SQL Server databases.

Download the raw data from the source site, filter the data and study it.

Created files, views, tables and data sets to support the business requirement.

Conduct meetings with stakeholders throughout development to gather system requirements.

Manage work as assigned on due dates. Notify the manager for any conflicts or issues related to timely delivery of the task assigned.

Documented the requirements as per business needs.

Extensively used Joins and Sub-Queries to simplify complex queries involving multiple tables.

Map the data column to that of the database to check for the error or data mismatch.

Design the control flow and write a query to execute between processes when required to perform certain tasks or manage the data destination.

Stage the data by cleansing and monitoring them.

Migrating the data from one environment to another.

Upload the data to the OLAP system and other destination data marts depending upon the requirement.

Analyze the data from multiple dimensions that were defined by creating dimensions.

Testing the data & ensure user acceptance testing was performed.

Ability to cultivate strong working team environment.

Environment: MS-Excel, SQL, Tableau

EDUCATION:

Bachelor of Technology in Computer Science



Contact this candidate