Hadoop Solution Architect

OVERVIEW:

Over **+ years of professional IT experience, this includes experience in Big Data & Oracle RAC administration.

3+Years of Experience as Hadoop admin/Architect on Cloudera and Hortonworks .

Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using, Cloudera and Hortonworks.

Hands-on experience with Hadoop cluster Designing, Implementation, configuration, Administration, debugging, and performance tuning

Implemented Cloudera Backup and Disaster Recovery (BDR) for enabling data protection across datacenters for Disaster Recovery scenarios

Excellent understanding of Hadoop Cluster security and implemented secure Hadoop cluster using Kerberos, Knox and Ranger

Hands on experience in installing, configuring, and using Hadoop ecosystem components like HIVE, Zookeeper, Sqoop, Flume, HUE, Spark on Cloudera & Hortonworks Hadoop Distribution.

Maintain, support, monitor and upgrade all Hadoop environments including configuration, access control, capacity planning, permissions and security patches to ensure continuity to all Hadoop environments

Domain Knowledge - Banking, Finance and Telecom.

DB Architect - Logical & Physical. Capacity planning & growth. Transparent data using synonyms and views for different application users accessing same database. Data modeling for wholesale banking applications using ERWIN, TOAD.

HA Solution Architect – Implemented HA solution for real time banking application using RAC, GoldenGate & Shareplex.

ETL - Data loading, mapping and filter using sql* loader and golden gate. Consolidate data from various DBMS into datamart database. Validate structure. Compare source and target.

Extensive hands-on experience on design and implementation high availability solutions for RDBMS and Hadoop

Project Management – worked as Technical PM on DataCenter Migration & Database Consolidation projects with cross functional teams

OTHER SKILLS – Proficient with SDLC methodologies (Waterfall and Agile) .

TEHNICAL SKILLS

OS : HP-UX, AIX, Solaris, Linux ( RedHat, CentOS), windows

RDBMS : Oracle 10g/11gR2/ 10g RAC / 11Gr2 RAC, MySQL

NoSQL : MongoDB

BigData : Apache Hadoop, Hive, Scoop, PIG, HBase, Flume, Spark, MapReduce, Zookeeper, Kylin

TOOLS : Toad, Erwin, OEM. Netbackup. BMC patrol, Autosys, Tomcat, Nagios and Ganglia.

HA Tools : Shareplex, Golden Gate

Programming : SQL, PL/SQL, HSQL, Unix Shell Scripting

PROFESSIONAL EXPERIENCE:

Alverstone Technologies

Principal Hadoop Consultant

Pleasanton, CA April-17 to Current

Roles & Responsibilities :

Currently working as a Hadoop Administrator/Architect supporting Hortonworks Hadoop distribution on dev, SIT, UAT and Prod environments

Responsible for design, installation, upgrades, system and performance monitoring on Hortonworks

Managing 350+ of nodes, which are on Dev, QA, Stage, PROD, DR, POC environments.

Created a strategy for replicating data across independent clusters as a Backup and Disaster Recovery solution. This also serves as a method for replicating Production data to the Development cluster for testing new jobs

Restoring required databases from OLD to NEW Cluster.

Enabling High availability for all Hadoop eco-tools

Configured HIVE, Sqoop, Hbase, Pig, HUE for application users.

Involved in Cluster Capacity planning along with expansion of the existing environment

Implemented strategy for Resource Management utilizing both Static Pools and Dynamic Resource Pool

Managing the health of Cluster, resolving performance related issues, coordinating with various parties for Infrastructure support.

Understanding the business requirements and needs and drawing the road map for Big data initiatives.

Providing 24x7 support

Syniverse Technologies

Sr. Oracle DBA / Hadoop SME

Campbell, CA May-2014 to Mar-2017

Roles & Responsibilities:

Oracle :

Working as Performance, Production and Development DBA - support DEV, SIT, UAT & Prod database environment

Consolidate Multiple OLTP databases .

Support 11gR2 RAC databases.

Real Application Testing – to analyze performance of (10g/11R1) Databases which migrate to 11gR2. Add filter based on various Attributes. Capture/Process work-load. Compare workload and replay using AWR and OEM to see performance improvement. Used SPA report to Measure Impact /Change in Execution Plans and analyze SQL statistics. Monitor Data divergence.

Data Guard – Setup Active data guard . Regression Test for Data Guard Replication to Measure Latency.

Goldengate - Setup and Monitor OGG on 11gR2. Setup Uni-directional Replication. Troubleshoot Replication Errors. Use Goldengate to Migrate Databases.

Tune - Database and Objects. Export / Import Baseline and statistics from Prod to UAT.

Hadoop :

Involved in Hadoop Cluster environment administrator that includes adding, decommissioning & re-balancing on Cloudra.

Installation & Configuration of fully distributed Hadoop cluster thru Cloudera manager and manually.

Managing 130+ nodes in the project on various Environments

Configuring Namenode High Availability in Hadoop Cluster

Backup and restores based on the business needs.

Involved in Optimization of Cluster as per the requirement.

Cluster monitoring, maintenance and troubleshooting the issues.

Hands on experience with opens source monitoring tools Nagios and Cloudera Manager.

Migrating data from one cluster to another using distcp.

Configuring schedulers based on the user requirements.

Upgrading Hadoop Cluster

Managing and administering meta data databases – MySQL

Logging a case with vendors and replacing the failed H/W and communicating to team and customer.

Performing monthly activities like generating Capacity & Availability reports for customers to reflect the average system uptime and utilization in terms of CPU, memory and file system.

Managing Server transitioning to Live Production & Decommissioning as per the requirement in environment.

ENVIRONMENT: RDBMS : 11gR2 RAC, Linux, GOLDENGATE, RMAN, RAC, ASM, Active DG and Grid control.

Big Data: Apache Hadoop, Hive, Hbase, Sqoop, Pig, Hive, MapReduce, Flume,Kylin, CDH4 and CDH5

JRK Consulting Services

Client: ACCENTURE Bangalore

Principle Consultant - Oracle / GoldenGate SME

Jan 2011 – Jan2014

Roles & Responsibilities:

Worked as Performance, Development & Production DBA - Creating and maintaining various database environments to support the system life cycle efforts.

RAC- 10g/11gR2 & Grid Infrastructure Clusters. Upgrade clusters from 11.2.0.1 to 11.2.0.3 in rolling-fashion. Apply Bug fix & PSU. Troubleshooting local/cluster-wide resources. Find RCA for Note eviction and failure. Configure SCAN -VIP / Listener. Configure 11.2.0.2 cluster for reboot-less Node evection. Load balance, Configure single-ton / Uniform services in cluster. Tune Parallel Operations.

Goldengate - Implementing GoldenGate on non-Rac and POC on Implementing GoldenGate on RAC. Configure Out-of-sync record reporting. Configure Goldengate for High-availability to fail-over Goldgate processes on surviving node. Trouble-shooting / Tuning Replication. bi-directional replication, conflict resolution. Automated Goldengate Installation & configuration. Created script to generate statistics report of DDL /DML per day. Mentor DBA / ETL Team.

Data guard - Developed Proof-of-Concept for Active dataguard vs Goldengate for Reporting. Setup snapshot database for RAT Testing. Stress testing for Physical standby. Monitor Archival Gap. Change dataguard Modes. Configure fast start failover. Configure Active Data Guard database.

Backup / Recovery – Setup and optimize RMAN backup on ASM. Registering local database to Catalog. Setup AUTOSYS job to perform non RMAN backup(s). Restore / clone /recover database using RMAN & Non RMAN backups.

Tuning - Used ADDM/AWR & Real-Time SQL reporting. Collect statistics, Mining AWR history of databases. Trouble-shoot query performance compare to earlier executions. Partition pruning / Partition Hash joints. Identify wait events. Testing & analysis of Query on Lower environments. Load data using exchange partition for ETL.

Grid control, monitoring, configure UDM, troubleshoot error related to agents and other issues. Generate weekly report on system heath check

Managed ASM storage Prepare/Add/remove ASM disks. Tuning of I/O on ASM based databases. Troubleshoot ASM problem

Logical and physical database design for new application based on business logic, faster response time, transparent data, future growth and application queries. Used ERWIN.

Troubleshooting - exchange partition with compress & bitmap index, text indexes.

DR Participate - DR testing using GoldenGate & Data Guard graceful switch over method

Hands on shell scripting.

Support onsite - offshore model

Provide 24x7 on-call

ENVIRONMENT: 10g /11gR1/11gR2 RAC, Unix/Linux, GOLDEN GATE, RMAN, ASM, DG, OEM, ETL,TOAD.

Wells Fargo Bank

Lead Oracle DBA/ Data Architect / GoldenGate / Shareplex SME

San Francisco JAN -04 to April- 10

Infrastructure DBA - Install Oracle 9i/10g/11g binaries. Apply in-place CPU Patch in 10g. Upgrade 9i/10g to 11g.

Development DBA for 50+ databases of Oracle 8i/9i/10g/11g on Unix, Linux REHL, HP-UX. .

Production DBA Support 8i/9i/10g /11g and RAC databases on HP-UX /Solaris/ Windows platform. Performed maintenance & implementations tasks. Working on OLTP/ DSS environment.

PL/SQL – Creating triggers and stored procedure on adhoc basis

Worked on full life cycle of database in five different stages with oracle 9i/10g on HP-UX, Solaris and Linux. Managing four different environments on OLTP, 4+TB, 900 users, 40+ databases

RAC- Administration / Trouble-shooting of 2 Node cluster on Oracle 10g. Configuring Grid Infrastructure & Listeners on 10gR1. Install oracle 10gR2 RAC binaries.

Managed ASM storage having 20+ databases. Prepare/Add/remove ASM disks. Tuning of I/O on ASM based databases.

Shareplex - Install /upgrade/ monitor, Hands on Trouble shooting Shareplex errors & reading logfiles . Performance / Latency test of Shareplex. Replicate from Oracle 9i to Oracle 10g. Estimate / Configure Shareplex processes according to Environment & volume of TPM .Write parameter files for CAPTURE/EXPORT/TRANSFORM/IMPORT/APPLY process to perform Replication /Transformation /exception handling.

GoldenGate – Install & monitor and worked on POC to replicate on real time mission critical applications.

Setup of Dataguard. Create physical & logical database as part of DR. Refresh standby database. Open physical in read/write mode. Flashback standby to restore point. Managing archival gap. Testing fail-over/ switch-over

Backup / Recovery – Write Rman Backup script as required. Restore backupset to Local server from Tape. Recover database to point-in-time on different host. Restore tables from Old backup. Recover corrupted Blocks from Rman backup.

Tuning Database using AWR/ADDM/ SQL trace. Hands on Various Tuning Advisor. Migrate SQL plans & statistics from QA to PROD. Schedule stats Job using DBMS_SCHEDULER. Used AWRSQL / SQL tuning package. Tune various SQL’s. Provide Primary investigation on Performance issue to application team in minimal time. Troubleshoot/mitigate various wait events in DB. Tuning of RAC instances and Database.

Grid control, monitoring, configure UDM, troubleshoot error related to agents and other issues.

Schema management including rename tables, identify object for defragmentation/ rebuilding, refresh schemas.

Used partitioning to create global/local index for better performance and management in OLAP environment.

Fix problematic SQL queries. Fix full scan and sorting issues. Capturing peak-load by running AWR snapshots. cpu & memory utilization by queries. Interact with developers for optimizing query. Analyzing tables & indexes to validate structure and gather statistics.

Data modeling to merge application schema. Reverse engineering from legacy database. Created star and hybrid schemas for data warehouse application.

Documentation of implementation plan and queries for structural changes in db

Worked on onsite-offshore model

Provide 24 x 7 on-call support

ENVIRONMENT: Oracle 9i/10g/10g RAC . HP-UX, SOLARIS, Linux, SHAREPLEX, RMAN, RAC, ASM, DG, OEM, ETL,TOAD.

AT Systems/TMP Worldwide / Hudson Global

Client : Wells Fargo Bank

Sr Oracle DBA

San Francisco – CA Aug -97 to Dec -03

Production DBA Support 8i/9i, 70+ OLTP/DSS databases on AIX, Solaris, HP-UX / Windows platform.

Support Development team, review codes, code migration to various non prod and production enviornments Also Data Center migration & Year 2000 projects.

Database Upgrade Upgrade databases from Oracle 8i to Oracle 9i.

Performance – Identify database top activities/ SQL/ sessions. In depth Analysis of SQL using tkprof, SQL Explain Plan and statspack report. Investigate top wait event & resolved it. Improving SQL performance for OLTP query by using tkprof and SQL xplain plan

SQL & PL/SQL – Creating triggers and stored procedure on ad-hoc basis

DR Participate DR testing using standby database graceful failover method

Write UNIX shell/perl scripts for monitoring alert log/memory/space utilization.

Documentation of methodology, Proof of concept and Implementation plan. Write Routine tasks on paper

Provide 24x7 on-call support

ENVIRONMENT: 8i/9i ORACLE, AIX, HP-UX, SOLARIS, WINDOWS, AUTOSYS, TOAD, ERWIN

EDUCATION: MS – Operational Research from Regional Engineering College, Trichy, India

BS - Mathamatics from MK University, Madurai

TRAINING : Attended 5 day RAC training session from Oracle University

Visa Status : US Citizen

Contact this candidate