{ Shankar Janakiraman
MBA (System)
Mobile: +91-984**-***** Email: ***.*******.*@*****.*** }
[ Technical Architect / Senior Manager ]
-[ AWS AZURE PYTHON PYSPARK HADOOP HIVE SQL AWS-LAMBDA DATABRICKS MYSQL TERADATA ORACLE REDSHIFT DYNAMODB RDS AWS GLUE MONGODB EC2 S3 LINUX SHELL SCRIPT HQL SCRIPTS VBA]
-[ Enterprise Data Warehouse Big Data
-Data Engineering Automation Data Extraction ETL Data Quality Data Services ]
[ Experience Summary: ]
●MBA-Systems graduate with 17 years of Experiences into Techno Functional Solutions with the,
ETL Projects, Data Modeling & Analysis (Data Accelerator Projects DWH (EDM in PROD);
Building Architecture & Development on ETL flow;
Technical Development & Automations and Change Management / RDM;
Developed & implemented ETL projects in California, USA and Automation in Tokyo, Japan.
AWS Solution Architect Certified & Azure Data Fundamental Certified
[ Organization Worked: ]
Designation
Company
Period
Senior Manager
Standard Chartered Global Business Services
Nov 2019 to Till Date
Architect
Agilisium Consulting Pvt Ltd
Nov 2018 to Oct 2019
Manager
Standard Chartered Global Business Services
Sep 2015 to Oct 2018
Assistant Manager
Barclays Shared Services Pvt Ltd, Chennai
Dec 2012 to Jan 2015
Team Lead
TCS (Morgan Stanley), Chennai
Feb 2010 to Dec 2012
Senior Analyst
WIPRO (Citi Bank), Chennai
Jan 2009 to Jan 2010
Team Lead
Royal Bank of Scotland (ABN AMRO), Chennai
Oct 2005 to Oct 2008
Document Specialist
RR Donnelley (Formerly OfficeTiger), Chennai
Mar 2004 to Oct 2005
System Executive
Shriram Investment Ltd, Chennai
Dec 2002 to Mar 2004
[ Recent Projects: ]
ACCOMPLISHMENTS
TECHNOLOGY
ETL: Oracle to S3 and Redshift
Databricks, S3, SQL Oracle, Redshift –Python & PySpark.
ETL: Salesforce to S3 & MySQL and Vice Versa
Databricks, S3, SQL, Mysql, Databricks–Python & PySpark.
ETL: Hive to Tableau
Hive, Hadoop, SQL, and PySpark.
SQL Optimizations
SQL performance reduced to 3 mins from 40 mins.
Client On-Boarding Project - SCB
Hive, Hadoop, SQL & Tableau
[ Technical Skills: ]
Python 3.6.1
(Pandas, Numpy, Seaborn)
&
PySpark-SQL
Databricks - PySpark
AWS – ETL Architect
Linux, HQL & VBA
(MS Excel and MS Access)
Building ETL data pipeline using PySpark & Python using Databricks & AWS Glue.
ETL Development in the Python per Business rules.
Designed through S3/HDFS based data flow.
Performed major data sources connectivity and Core development using PySpark.
Tuning & Optimization of the scripts.
End to End Designing & development of technical architecture & ETL flow.
Automating the daily operation tasks using Python & Pandas as process improvements.
Development in the Data Flow, Data Extraction & Data Quality.
Managed technical members in the development for ETL & Automation
Architecture development in AWS Glue using PySpark for ETL.
Coordinated with end users for designing & implementation of analytics.
Prepared scripts to ensure proper data reporting functions with Python.
Formulated procedures to integrate the Python with data sources and delivery systems.
Performed many Process Improvements in operation with Python, HQL & VBA scripts
Hadoop (HDFS) 2.7.1.2.3,
Hive -1.2.1.2.3,
Pig – 0.15.0.2.3
Teradata, MySQL,
Oracle,
SQL Server
AWS S3,
Tableau
Complex SQLs development per business rules.
ETL SQLs development & Tuning to reduce time.
Development of sources/target in Logical Design, Physical Design, HIVE Table Definitions and MySQL, Oracle, Teradata sources flow design.
Parameterized SQLs in ETL & Automation in complex business rules.
Develop & arrange the SQLs per real upstream & downstream flows.
Developed end to end data mappings using SQLs and Table structure.
Experienced in connectivity with SQLs using PySpark & Python.
DWH Tier 1 Data Analysis on the Big Data HIVE in EDM Prod Environment.
Analyze Trend & T1 vs. T2 recon in EDM Data warehouse.
Data Mapping & Data Profiling from Source to T1 using shell scripting in HIVE.
Data Extraction & automation scripts from HDFS, Hive & Teradata.
Data Recon with sources such as EBBS, ACBS, Murex, Hogan, SCI & FM sys.
Special Projects support in DW Prod from multiple sources.
LINUX Shell & HQL scripts design for HADOOP & HIVE SQL Requirements.
Data Visualize design practice on the client onboarding project.
Techno-Functional Consultant (Architect & Manager)
Working with stakeholders to analyze use cases for business requirements.
Handling UVT, Data Profiling and Extraction of DWH requirements.
Defining data requirements & designing databases for client business objectives.
Analyzing content, Dashboards & Reports and Developing ETL processes.
Special Projects on data sources from DWH for Business Workflow.
Architectural, Functional & Technical Documents arrangements.
[ Project Details: ]
Projects in Enterprise Data Management (EDM-Data warehousing) & Process Improvements.
1. RepAI: ETL interface Mappings with Python & PySpark through EC2 and AWS -Glue
9. Project SAIL: Scripts & SQL developments: PROD to DEV data transformation for all systems.
2. Client on Boarding Dashboard Project: Data modeling and Extraction Support along with HQL & shell scripts development for Tableau based dashboard.
10. Project NTB: client’s scripts & SQL development: Data Extractions for New to Bank Clients for specific products.
3. Data Remediation Project: SQL developments: Data Cleansing identification in multiple systems by country code and nationality. Data Modeling reviews.
11. Intraday Balance project: SQL & Script development: Day to Day balance by Account no and Currency code for all countries.
4. Project Diaocha: SQL & scripts developments: Data exception extractions for all countries.
12. Ad-hoc Extraction Queries: Regulatory Reporting, Other Data Cleansing, Front end developments, Reconciliation Summary AD-HOC Query developments.
5. Excess Balance Summary: HIVE SQL development & Analysis: Transaction Balance analysis by Account No & Currency code by script for all countries.
13. Data Quality: Assisted to develop HQL & Shell scripts for Data Quality Business rules.
6. Client Status: Client Derived Status scripts developments: Data cleansing by customer status.
14. SQL & VBA Development Projects: Developed & Implemented. Tool implemented in Tokyo, Japan. VBA & SQL developments for process improvements & Cost Allocation process.
7. PBOC: Compliance Query and script developments: China based counterparties to be extracted with full details by agreed parameters for Data Cleansing.
15. Global Applications Used: Kondor + 2.5, 2.6, WallStreet, Adaptiv, Mainframe, SAFE, FISS and Bloomberg
8. BRRD Project: Data Extraction Query and script developments: Data extraction for Regulatory Reporting purpose.
[ Education: ]
Degree
Elective
College & University
Class
Year
MBA
Systems
Madras University
Second
2013
B. Com
Commerce
Voorhees College, Vellore
First
2001
+2
Commerce
K.A.K.M High Sec School
First
1998
10th
General
K.A.K.M High Sec School
Second
Mar & Oct 1995
DCA
VB & Oracle
CSC
First
1999
[ Certification: ]
CREDENTIAL
TECHNOLOGY
AWS Solution Architect
AWS
Azure Data Fundamentals
Azure
Edureka
BIG DATA & HADOOP
Udemy
PYSPARK & Machine Learning
Udemy
Machine Learning
[ Experience Details: ]
Nov 2019 to Till Date Standard Chartered Global Business Services
Senior Manager
Enterprise Data Management Service Delivery (EDM)
Fine tuning the SQL queries –Big Data – Hive, PySpark & Teradata.
Data Extractions & modeling support from Hive, PySpark & Teradata using Complex SQL queries.
SHELL Scripts developments with HQL scripts.
ETL process using python scripts with PySpark RDD for data lakes
Technical support for T1 & T2 Layers for Data loading and Extraction
Nov 2018 to Oct 2019 Agile Business Intelligence Service Pvt Ltd (Agilisium Consulting)
Architect
ETL Development and Architecture
Developed ETL architect from Oracle to Redshift through Redshift.
Developed ETL architect from MySQL to S3.
Requirement gathering from multiple operations in USA for ETL process.
Driving POC for initial requirements.
Designed and Developed the SQL to formulate the mappings.
Developed the script in PySpark for all the interfaces.
Architected the flow of data with AWS – GLUE using PySpark.
Optimizing the SQL flow into AWS.
Sep 2015 to Oct 2018 Standard Chartered Global Business Services
Manager
Enterprise Data Management Service Delivery (EDM)
Manage Data Driven research, Identify statistical relationships, Perform Data Profiling.
Gather Business understanding and serve liaison between business and developers.
Participating in developing final deliverable, reports and visualizations.
Data Quality measure & analysis on the Sources & Tier 1 layers in EDM PROD.
Fine tuning the SQL queries –Big Data – Hive, PySpark & Teradata.
Data Recon between sources & T1 such as ebbs, ACBS, SCI, MUREX, HOGAN and FM Sys.
Data Extractions & modeling support from Hive, PySpark & Teradata using Complex SQL queries.
SHELL Scripts developments with HQL scripts.
Prepared Business Catalogue for EDM data warehousing.
ETL process using python scripts with PySpark RDD.
Technical support for T1 & T2 Layers in terms of Data Quality and Data Mapping.
Golden Sources load Status analysis in Hadoop – Hive.
Python Functions using PySpark Core Data report development and managed for EDM.
Managing Partitioning for Data loading into Hadoop & HIVE file & tables.
Dec 2012 – Jan 2015 Barclays Shared Services Pvt Ltd
Assistant Manager (Band 4) – Techno-Functional Consultant.
Business Process Improvements: Change Management.
Big Data: Data feasibility analysis with HIVE Query for POC.
Big Data: Data mapping analysis with source systems.
Big Data: SQL tuning support in Big Data – HIVE & SQL Server.
SQL Server: ETL load datasets analysis
SQL Server: Data mapping and analysis for agreed outcome.
Cost Allocation Data Analytics & Mapping and DB Development.
% allocations for costs based on Stakeholders requirements across regions.
Perform the feasibility study, Identification of GAPS, To Be Process requirements.
Database Connectivity, RDBMS design, SQL, MS Access Database Maintenance.
Develop Queries/Tables/VBA Scripts and Tools & Dashboards in MS-Access & MS Excel.
Enhance ADO/DAO connectivity to capture data ETL Process.
Develop VBA scripts to export and import data among Excel, Access & SharePoint.
Coordinate with users to produce comprehensive test plan, UAT and signoff.
Feb 2010 - Dec 2012 TCS EServe International Ltd (Morgan Stanley)
Team Lead (Band 3) – Techno-Functional Consultant.
EPIX –Enterprise Data Management: Equities & Fixed Income
Issuer linking connectivity analysis between Security and Issuer through SQL.
EQ & FI Counterparty, Issuer and Security setup and Data Reconciliations and Cleansing.
Data Mapping and Data Issues resolved by SQL for Issuer Link and Product Control.
Enable the Issuer linking data in Database as per Regulatory requirements.
Reconciling the system linked issuers Data by SQL for Corporate Action updates.
Implemented, managed and customized new VBA scripts on MS-Excel & MS Access tools.
Database & Metrics with MS Excel VBA & connected to the server through ADO/DAO.
Requirement Gathering, Feasibility Study and Developing Scripts & Queries in MS Access.
Jan 2009 – Jan 2010 Wipro (Citi Bank) Assistant Manager (Level 2A): –Senior Analyst.
Reference Data Management: Fixed Income
Fixed Income Security set up & updates in Mainframe as per Bloomberg.
Tolerance Issue solving by various Calc Method. (Act 360, Act/Act, Act/365, 30/360).
Issuer & Counterparty setup, mapping and linking.
Data Analysis and Data Mapping for Reference Data Management.
Developed & Maintained MS Access database to capture Trade Details.
Oct 2005 – Oct 2008 Royal Bank of Scotland (ABN AMRO)
Team Lead (Band 3)
Managed FX/MM, FI, Equity and Derivatives in Reference Data Management:
Team Management and Operational Support & VBA Automation:
Ensure that SLA’s and Accuracy‘s met with the agreed level.
Follow-up Activities, Verifications, Authorizations, EOD reviews, Performance Appraisals, Team Productivity, Process Improvements, Escalations & Report Management, VBA Scripts.
Counterparty, Trade Confirmations, CLS, Standard Settlement Instructions & Broker set up:
Bank, Counterparty, Back to Back, Issuer & Custodian setup for FI, Equities & FX/MM.
Facilitate Trade Confirmation in Global systems for FX / MM, Fixed Income & EQ Trades.
SWIFT deactivation, SSI’s Clean-Up’s, Corporate Actions & Counterparty Data Cleansing.
Instruments / Securities / Treasury and Other Trade Support Activities:
Setting up of Bonds (Fixed & FRN) and Paper deals (CD’s, CP’s Bill of Exchange & T-bill).
Resolving the Day Count Tolerance accrue in Bonds. (Act 360, Act/Act, Act/365, 30/360).
Mar 2004 - Oct 2005 RR Donnelley (Office Tiger)
Document Specialist:
Verifying the transactions comply with financial policies and procedures with SEC.
Updating & Maintaining the Receivables & Payables by totaling unpaid invoices.
Dec 2002 - Mar 2004 Shriram Investments Ltd., (Head Office - Chennai)
System Executive:
Server Maintenance & Accounting Database development in FoxPro.
Data Reconciliation and Analysis with multiple sources and consolidated data.
Shankar Janakiraman