Hadoop admin

SATYA RAJU

PROFESSIONAL SUMMARY:

* ***** ** ********** ** Systems Administration and Data Analytics with specialization in Hadoop Ecosystem and Big Data Technologies.

* ***** ** ********* *********e as Hadoop Administrator with strong expertise in Administering HBASE, SPARK, KAFKA.

Strong Experience in Implementation and Administration of Hadoop Infrastructure

Strong hands on experience in designing optimized solutions using various Hadoop components like Mapreduce, Hive, Sqoop, Pig, HDFS, Flume, Oozie etc.

Operational expertise in trouble shooting systems capacity & bottlenecks

Strong Understanding of memory, CPU, OS, Storage and networks

Strong Understanding of Cassandra and NoSQL Databases.

Experience in using Hadoop Schedulers FIFO, Fair Scheduler, Capacity Scheduler

Strong skills in writing UNIX and Linux scripts.

Experience in Backup and Disaster recovery strategies

Strong Hands-on in creating and removal of nodes using tools like Nagios, Ganglia’s etc.

Performance tuning of Hadoop Clusters and Hadoop MapReduce routines

Used to communicate with the Cloudera team in case there is any critical issue that cannot be resolved very easily as the background of this Hadoop-Kerberos security environment is supported by the Cloudera team.

Hands on experience in upgrading Cisco IOS & Firmware on different Cisco devices & modules.

Proficiency in configuration of Layer2 and Layer3 Virtual Local Area Networks (VLANS) using Cisco multi-layer Switches supporting STP, RSTP, PVST along with inter VLAN routing and VLAN trunking 802.1q.

Worked on Network security skills include NAT/PAT, ACLs, AAA and ASA firewall.

Worked on configuration of Palo Alto firewalls including Security policies, Application & URL filtering, Data filtering, Threat prevention and File blocking.

Familiar with Cisco Security Telnet, NAT/ACLs, AAA, Layer 2 Security, Layer 3 Security, IPS/IDS, Cisco (ASA, PIX) 5510, Cryptography, VPN, IPsec.

Extraordinary skills towards IPv4 (subnetting & supernetting); Familiar about IPv6 address management.

Experienced in DNS, DHCP, SMTP, FTP, HTTPS and web security architecture.

Remediation of firewall rules from checkpoint firewalls to Cisco ASA firewalls and their implementation.

SKILLS

Operating Systems: Windows 2000 Server, Windows 2000 Advanced Server, Windows Server 2003 Windows NT, Windows 98/XP UNIX, Linux RHEL, Cisco IOS

Database: MS SQL Server 2000/2005/2008, MS-Access, Tera Data, Oracle 9i/10g, Cassandra, HBASE

Languages: JAVA, C, C++, PIG, HIVE

Tools/Utilities: MapReduce, Sqoop, Flume, Oozie, SQL Profiler

Web Utilities: HTTP, IIS Administration, APACHE

Router & Switches Platforms: Cisco routers 7300, 3900, 3800, 2900, 2800, 2600, 1900, 1600 series, Cisco Switches 3560, 3750, 4500, 4900 & 6500 series, Juniper MX (2200, 3400) series, EX (104,240) series.

Firewalls: Palo Alto (3060, 5060), Cisco ASA (5500 series), Juniper SRX.

Network Security: ACL’s, MPF, IPSEC VPN, Port Security, AAA and IDS/IPS.

Protocols: OSI Model, TCP/IP, UDP, DHCP, DNS, HSRP, ETHERNET, RIP v2, OSPF, EIGRP, BGP, NAT, ARP, VTP, STP

Port: channel, VLANS, VTP, STP, RSTP, 802.1Q

LAN Technologies: Ethernet, Fast Ethernet, and Gigabit Ethernet, SMTP, VLAN, Inter-VLAN

PROFESSIONAL EXPERIENCE:

Dish Networks Roseland, NJ Oct 2016 – Present

Hadoop Administrator

Responsibilities:

Installed and Configured multi-nodes fully distributed Hadoop cluster

Involved in Installing Hadoop Ecosystem components

Responsible to manage data coming from different sources

Setup Hadoop Cluster environment administration that includes adding and removing cluster nodes, cluster capacity planning and performance tuning

Developed multiple Map Reduce jobs in Java for data cleaning and processing

Written Complex Map reduce programs

Handled importing of data from various data sources, performed transformations using Hive, Map Reduce and loaded data into HDFS

Involved in HDFS maintenance and administering it through Hadoop-Java API

Configured Fair Scheduler to provide service level agreements for multiple users of a cluster

Loaded data into the cluster from dynamically generated files using FLUME and from RDBMS using Sqoop

Involved in writing Java API’s for interacting with HBase

Involved in writing Flume and Hive scripts to extract transform and load data into Database

Used HBase as the data storage

Experience in using SPARK.

Installation of Storm and Kafka on 40 node Cluster

Written Storm topology to accept the events from Kafka Producer and emit into Cassandra DB

Written JUNIT test cases for Storm Topology

Environment: Java Map Reduce, Hive, HBASE. Flume, Sqoop, Spark, Storm, Kafka, Cassandra

PG & E San Francisco, CA Aug 2015 – Aug 2016

Hadoop Administrator

Responsibilities

Identify and decide on the tools/utilities to extract data into Hadoop

Created Map Reduce jobs for data transformations and data parsing

Created Hive scripts for extracting the summarized information from hive tables

Collaborate with Cross functional teams to gather requirements to ensure the applications are properly configured and deployed

Write Apache Pig Latin scripts to do data filtering in HDFS and upload in Hive tables.

Installed Configured Sentry as Security layer for accessing

Develop UDF to enhance Apache Pig and Hive features for client specific data filtering logics

Experience in using SPARK.

Writing map-reduce jobs

Written Automation scripts using Puppet

Environment: UNIX, Linux, CDH 4 distribution, Tableau, Hive, Map Reduce Puppet

SunGard, India May 2014 – May 2015

Network Engineer

Responsibilities:

Installing and maintaining of network infrastructure and Configure, administer, firewall administration and document firewall infrastructure.

Configuring Static, RIP, IGRP, EIGRP, and OSPF Routing Protocols on Cisco 1600, 2600, 2800, 3600, 7300 series Routers.

Worked on Address translating protocols NAT& PAT policies.

Has expertise in LAN/WAN technologies (fast Ethernet, Layer2 & 3 switched/routed LAN, and Frame Relay).

Extensively used TCP/IP tool like TELNET for remote login to the routers and SSH for secure login.

Earned knowledge to maximize network performance by tracking performance, troubleshooting network problems and outages scheduling upgrades.

Designed and configured inside & outside (Standard &Extended) ACL interfaces.

Troubleshoot connectivity issues involving VLAN& OSPF, QoS etc.

Implementation and operational support of routing/switching protocols including RIP, OSPF, EIGRP, Spanning Tree, 802.1q, etc.

Perform inventory and data gathering by using SSH session to obtain the Router configuration information like interface address/subnet mask, Model, Serial Number, IOS Version, Flash Memory, Status of the interface and the next hop site of the WAN interface.

Configure various LAN switches such as CISCO CAT 2900, 3550, 4500 switches.

Provided configuration and management of FTP server and DHCP server.

Analyzing traffic flow of all Cisco hardware using Cisco Works, and hands in SNMP Network management.

Experience using static routing and default routing, review all system logs and resolving any network issues.

Assisted in troubleshooting complex layer 1, 2 and 3 connectivity using WireShark protocol analyzer and recommended solution for better performance.

CSC, India Sep 2012 – April-2014

System Engineer

Responsibilities:

Key contributions include troubleshooting of complex LAN/WAN infrastructure that include.

Configured Firewall logging, DMZs & related security policies & monitoring.

Configured network access servers and routers for AAA Security (RADIUS/ TACACS+)

Creating Private VLANs & preventing VLAN hopping attacks & mitigating spoofing with snooping & IP source guard.

Other responsibilities included documentation and change control.

Responsible for Configuring SITE_TO_SITE VPN on Cisco Routers between Head Quarters and Branch locations.

Used various scanning and sniffing tools like Wire-shark.

Hands on Experience working with security issue like applying ACL’s, configuring NAT and VPN

Involved in troubleshooting of DNS, DHCP and other IP conflict problems.

Implement ACLs and authenticate (EIGRP, BGP) to ensure high security on the network.

Implemented the security architecture for highly complex transport and application architectures addressing well known vulnerabilities and using access control lists that would serve as their primary security on their core & failover firewalls.

Implement Cisco Works to manage Cisco routers, switches, firewall, Access Points and VPN concentrators.

Develop, plan and maintain documentation necessary for operation in support of LAN to WAN connectivity.

Used DHCP to automatically assign reusable IP addresses to DHCP clients.

Lumin Innovative Web Services Jan-2011 – Aug 2012

Network Engineer

Responsibilities:

Monitor, configure changes on installed Cisco networking devices such as Routers and

Switches to address network related issues/problems.

Maintenance of client wide area networks (WAN) and local area networks (LAN).

Analyze client system needs and requirements for the project proposal and design.

Troubleshoot a wide range of technical support issues and connectivity problems such as authentication, connection speed, e-mail configuration, and loss of synchronization.

Provided Technical support for improvement, upgrading and expansion of the existing network architecture.

Configured STP for loop prevention and VTP for Inter-VLAN Routing.

Gained good knowledge working on Cisco ASA firewalls configuring static routes, ACLs (standard & extended).

Configured Access lists (Standard and Extended) to manage IP traffic for users all over the company to access different applications and blocking others.

Hands on Experience working with security issue like applying ACL, configuring NAT and VPN.

Troubleshoot network issues onsite and remotely depending on the severity of the issues.

Used Solar winds to monitor networks and troubleshooting.

Education:

Bachelor of Engineering JNT University

Contact this candidate