{ Shankar Janakiraman

MBA (System)

Mobile: +91-984**-***** Email: adqge7@r.postjobfree.com }

[ Technical Architect / Senior Manager ]

-[ AWS AZURE PYTHON PYSPARK HADOOP HIVE SQL AWS-LAMBDA DATABRICKS MYSQL TERADATA ORACLE REDSHIFT DYNAMODB RDS AWS GLUE MONGODB EC2 S3 LINUX SHELL SCRIPT HQL SCRIPTS VBA]

-[ Enterprise Data Warehouse Big Data

-Data Engineering Automation Data Extraction ETL Data Quality Data Services ]

[ Experience Summary: ]

●MBA-Systems graduate with 17 years of Experiences into Techno Functional Solutions with the,

ETL Projects, Data Modeling & Analysis (Data Accelerator Projects DWH (EDM in PROD);

Building Architecture & Development on ETL flow;

Technical Development & Automations and Change Management / RDM;

Developed & implemented ETL projects in California, USA and Automation in Tokyo, Japan.

AWS Solution Architect Certified & Azure Data Fundamental Certified

[ Organization Worked: ]

Designation

Company

Period

Senior Manager

Standard Chartered Global Business Services

Nov 2019 to Till Date

Architect

Agilisium Consulting Pvt Ltd

Nov 2018 to Oct 2019

Manager

Standard Chartered Global Business Services

Sep 2015 to Oct 2018

Assistant Manager

Barclays Shared Services Pvt Ltd, Chennai

Dec 2012 to Jan 2015

Team Lead

TCS (Morgan Stanley), Chennai

Feb 2010 to Dec 2012

Senior Analyst

WIPRO (Citi Bank), Chennai

Jan 2009 to Jan 2010

Team Lead

Royal Bank of Scotland (ABN AMRO), Chennai

Oct 2005 to Oct 2008

Document Specialist

RR Donnelley (Formerly OfficeTiger), Chennai

Mar 2004 to Oct 2005

System Executive

Shriram Investment Ltd, Chennai

Dec 2002 to Mar 2004

[ Recent Projects: ]

ACCOMPLISHMENTS

TECHNOLOGY

ETL: Oracle to S3 and Redshift

Databricks, S3, SQL Oracle, Redshift –Python & PySpark.

ETL: Salesforce to S3 & MySQL and Vice Versa

Databricks, S3, SQL, Mysql, Databricks–Python & PySpark.

ETL: Hive to Tableau

Hive, Hadoop, SQL, and PySpark.

SQL Optimizations

SQL performance reduced to 3 mins from 40 mins.

Client On-Boarding Project - SCB

Hive, Hadoop, SQL & Tableau

[ Technical Skills: ]

Python 3.6.1

(Pandas, Numpy, Seaborn)

&

PySpark-SQL

Databricks - PySpark

AWS – ETL Architect

Linux, HQL & VBA

(MS Excel and MS Access)

Building ETL data pipeline using PySpark & Python using Databricks & AWS Glue.

ETL Development in the Python per Business rules.

Designed through S3/HDFS based data flow.

Performed major data sources connectivity and Core development using PySpark.

Tuning & Optimization of the scripts.

End to End Designing & development of technical architecture & ETL flow.

Automating the daily operation tasks using Python & Pandas as process improvements.

Development in the Data Flow, Data Extraction & Data Quality.

Managed technical members in the development for ETL & Automation

Architecture development in AWS Glue using PySpark for ETL.

Coordinated with end users for designing & implementation of analytics.

Prepared scripts to ensure proper data reporting functions with Python.

Formulated procedures to integrate the Python with data sources and delivery systems.

Performed many Process Improvements in operation with Python, HQL & VBA scripts

Hadoop (HDFS) 2.7.1.2.3,

Hive -1.2.1.2.3,

Pig – 0.15.0.2.3

Teradata, MySQL,

Oracle,

SQL Server

AWS S3,

Tableau

Complex SQLs development per business rules.

ETL SQLs development & Tuning to reduce time.

Development of sources/target in Logical Design, Physical Design, HIVE Table Definitions and MySQL, Oracle, Teradata sources flow design.

Parameterized SQLs in ETL & Automation in complex business rules.

Develop & arrange the SQLs per real upstream & downstream flows.

Developed end to end data mappings using SQLs and Table structure.

Experienced in connectivity with SQLs using PySpark & Python.

DWH Tier 1 Data Analysis on the Big Data HIVE in EDM Prod Environment.

Analyze Trend & T1 vs. T2 recon in EDM Data warehouse.

Data Mapping & Data Profiling from Source to T1 using shell scripting in HIVE.

Data Extraction & automation scripts from HDFS, Hive & Teradata.

Data Recon with sources such as EBBS, ACBS, Murex, Hogan, SCI & FM sys.

Special Projects support in DW Prod from multiple sources.

LINUX Shell & HQL scripts design for HADOOP & HIVE SQL Requirements.

Data Visualize design practice on the client onboarding project.

Techno-Functional Consultant (Architect & Manager)

Working with stakeholders to analyze use cases for business requirements.

Handling UVT, Data Profiling and Extraction of DWH requirements.

Defining data requirements & designing databases for client business objectives.

Analyzing content, Dashboards & Reports and Developing ETL processes.

Special Projects on data sources from DWH for Business Workflow.

Architectural, Functional & Technical Documents arrangements.

[ Project Details: ]

Projects in Enterprise Data Management (EDM-Data warehousing) & Process Improvements.

1. RepAI: ETL interface Mappings with Python & PySpark through EC2 and AWS -Glue

9. Project SAIL: Scripts & SQL developments: PROD to DEV data transformation for all systems.

2. Client on Boarding Dashboard Project: Data modeling and Extraction Support along with HQL & shell scripts development for Tableau based dashboard.

10. Project NTB: client’s scripts & SQL development: Data Extractions for New to Bank Clients for specific products.

3. Data Remediation Project: SQL developments: Data Cleansing identification in multiple systems by country code and nationality. Data Modeling reviews.

11. Intraday Balance project: SQL & Script development: Day to Day balance by Account no and Currency code for all countries.

4. Project Diaocha: SQL & scripts developments: Data exception extractions for all countries.

12. Ad-hoc Extraction Queries: Regulatory Reporting, Other Data Cleansing, Front end developments, Reconciliation Summary AD-HOC Query developments.

5. Excess Balance Summary: HIVE SQL development & Analysis: Transaction Balance analysis by Account No & Currency code by script for all countries.

13. Data Quality: Assisted to develop HQL & Shell scripts for Data Quality Business rules.

6. Client Status: Client Derived Status scripts developments: Data cleansing by customer status.

14. SQL & VBA Development Projects: Developed & Implemented. Tool implemented in Tokyo, Japan. VBA & SQL developments for process improvements & Cost Allocation process.

7. PBOC: Compliance Query and script developments: China based counterparties to be extracted with full details by agreed parameters for Data Cleansing.

15. Global Applications Used: Kondor + 2.5, 2.6, WallStreet, Adaptiv, Mainframe, SAFE, FISS and Bloomberg

8. BRRD Project: Data Extraction Query and script developments: Data extraction for Regulatory Reporting purpose.

[ Education: ]

Degree

Elective

College & University

Class

Year

MBA

Systems

Madras University

Second

2013

B. Com

Commerce

Voorhees College, Vellore

First

2001

+2

Commerce

K.A.K.M High Sec School

First

1998

10th

General

K.A.K.M High Sec School

Second

Mar & Oct 1995

DCA

VB & Oracle

CSC

First

1999

[ Certification: ]

CREDENTIAL

TECHNOLOGY

AWS Solution Architect

AWS

Azure Data Fundamentals

Azure

Edureka

BIG DATA & HADOOP

Udemy

PYSPARK & Machine Learning

Udemy

Machine Learning

[ Experience Details: ]

Nov 2019 to Till Date Standard Chartered Global Business Services

Senior Manager

Enterprise Data Management Service Delivery (EDM)

Fine tuning the SQL queries –Big Data – Hive, PySpark & Teradata.

Data Extractions & modeling support from Hive, PySpark & Teradata using Complex SQL queries.

SHELL Scripts developments with HQL scripts.

ETL process using python scripts with PySpark RDD for data lakes

Technical support for T1 & T2 Layers for Data loading and Extraction

Nov 2018 to Oct 2019 Agile Business Intelligence Service Pvt Ltd (Agilisium Consulting)

Architect

ETL Development and Architecture

Developed ETL architect from Oracle to Redshift through Redshift.

Developed ETL architect from MySQL to S3.

Requirement gathering from multiple operations in USA for ETL process.

Driving POC for initial requirements.

Designed and Developed the SQL to formulate the mappings.

Developed the script in PySpark for all the interfaces.

Architected the flow of data with AWS – GLUE using PySpark.

Optimizing the SQL flow into AWS.

Sep 2015 to Oct 2018 Standard Chartered Global Business Services

Manager

Enterprise Data Management Service Delivery (EDM)

Manage Data Driven research, Identify statistical relationships, Perform Data Profiling.

Gather Business understanding and serve liaison between business and developers.

Participating in developing final deliverable, reports and visualizations.

Data Quality measure & analysis on the Sources & Tier 1 layers in EDM PROD.

Fine tuning the SQL queries –Big Data – Hive, PySpark & Teradata.

Data Recon between sources & T1 such as ebbs, ACBS, SCI, MUREX, HOGAN and FM Sys.

Data Extractions & modeling support from Hive, PySpark & Teradata using Complex SQL queries.

SHELL Scripts developments with HQL scripts.

Prepared Business Catalogue for EDM data warehousing.

ETL process using python scripts with PySpark RDD.

Technical support for T1 & T2 Layers in terms of Data Quality and Data Mapping.

Golden Sources load Status analysis in Hadoop – Hive.

Python Functions using PySpark Core Data report development and managed for EDM.

Managing Partitioning for Data loading into Hadoop & HIVE file & tables.

Dec 2012 – Jan 2015 Barclays Shared Services Pvt Ltd

Assistant Manager (Band 4) – Techno-Functional Consultant.

Business Process Improvements: Change Management.

Big Data: Data feasibility analysis with HIVE Query for POC.

Big Data: Data mapping analysis with source systems.

Big Data: SQL tuning support in Big Data – HIVE & SQL Server.

SQL Server: ETL load datasets analysis

SQL Server: Data mapping and analysis for agreed outcome.

Cost Allocation Data Analytics & Mapping and DB Development.

% allocations for costs based on Stakeholders requirements across regions.

Perform the feasibility study, Identification of GAPS, To Be Process requirements.

Database Connectivity, RDBMS design, SQL, MS Access Database Maintenance.

Develop Queries/Tables/VBA Scripts and Tools & Dashboards in MS-Access & MS Excel.

Enhance ADO/DAO connectivity to capture data ETL Process.

Develop VBA scripts to export and import data among Excel, Access & SharePoint.

Coordinate with users to produce comprehensive test plan, UAT and signoff.

Feb 2010 - Dec 2012 TCS EServe International Ltd (Morgan Stanley)

Team Lead (Band 3) – Techno-Functional Consultant.

EPIX –Enterprise Data Management: Equities & Fixed Income

Issuer linking connectivity analysis between Security and Issuer through SQL.

EQ & FI Counterparty, Issuer and Security setup and Data Reconciliations and Cleansing.

Data Mapping and Data Issues resolved by SQL for Issuer Link and Product Control.

Enable the Issuer linking data in Database as per Regulatory requirements.

Reconciling the system linked issuers Data by SQL for Corporate Action updates.

Implemented, managed and customized new VBA scripts on MS-Excel & MS Access tools.

Database & Metrics with MS Excel VBA & connected to the server through ADO/DAO.

Requirement Gathering, Feasibility Study and Developing Scripts & Queries in MS Access.

Jan 2009 – Jan 2010 Wipro (Citi Bank) Assistant Manager (Level 2A): –Senior Analyst.

Reference Data Management: Fixed Income

Fixed Income Security set up & updates in Mainframe as per Bloomberg.

Tolerance Issue solving by various Calc Method. (Act 360, Act/Act, Act/365, 30/360).

Issuer & Counterparty setup, mapping and linking.

Data Analysis and Data Mapping for Reference Data Management.

Developed & Maintained MS Access database to capture Trade Details.

Oct 2005 – Oct 2008 Royal Bank of Scotland (ABN AMRO)

Team Lead (Band 3)

Managed FX/MM, FI, Equity and Derivatives in Reference Data Management:

Team Management and Operational Support & VBA Automation:

Ensure that SLA’s and Accuracy‘s met with the agreed level.

Follow-up Activities, Verifications, Authorizations, EOD reviews, Performance Appraisals, Team Productivity, Process Improvements, Escalations & Report Management, VBA Scripts.

Counterparty, Trade Confirmations, CLS, Standard Settlement Instructions & Broker set up:

Bank, Counterparty, Back to Back, Issuer & Custodian setup for FI, Equities & FX/MM.

Facilitate Trade Confirmation in Global systems for FX / MM, Fixed Income & EQ Trades.

SWIFT deactivation, SSI’s Clean-Up’s, Corporate Actions & Counterparty Data Cleansing.

Instruments / Securities / Treasury and Other Trade Support Activities:

Setting up of Bonds (Fixed & FRN) and Paper deals (CD’s, CP’s Bill of Exchange & T-bill).

Resolving the Day Count Tolerance accrue in Bonds. (Act 360, Act/Act, Act/365, 30/360).

Mar 2004 - Oct 2005 RR Donnelley (Office Tiger)

Document Specialist:

Verifying the transactions comply with financial policies and procedures with SEC.

Updating & Maintaining the Receivables & Payables by totaling unpaid invoices.

Dec 2002 - Mar 2004 Shriram Investments Ltd., (Head Office - Chennai)

System Executive:

Server Maintenance & Accounting Database development in FoxPro.

Data Reconciliation and Analysis with multiple sources and consolidated data.

Shankar Janakiraman

Contact this candidate