AIX/UNIX/LINIX ADMIN
Resume:
Harmandeep Deol
acrl9m@r.postjobfree.com
SUMMARY:
* ***** ** ********** ** Installation, configuration, troubleshooting, Systems Security, Systems Monitoring, Storage Systems, Operating Systems, Performance Analysis, and Capacity Planning of various AIX Servers.
Experience working in heterogeneous server environments including P-series 550, 570,590, 595 690, RS/6000, IBM Blade server JS20, Sun Fire Servers, Sun Enterprise Servers.
Experience in Installation and Administration of AIX servers (v4.3, v5.2, v5.3, v7.1)
Experience in Installation and Administration of IBM VIO servers and HMC
Providing 24X7 On-call Production and Customer Support including trouble shooting problems related to IBM AIX pSeries servers and Sun Systems Solaris servers
Planning, Installation, Configuration, Maintenance and Administration of AIX 4.3/5.1/5.2/5.3 and day to day system admin tasks Setting up printers / remote queues / Info-print management Migration upgrades of AIX (433/51/52/53),Including system tuning, security, backup, recovery and upgrades of IBM AIX and Sun Solaris.
Performing Kickstart to build out Linux environments to automate Linux installations with Kickstart to avoid manual intervention.
Expertise in doing NIM installations on AIX 5.2/5.3/7.1
Installation and support for the Power Broker v5.1 and Power Password v3.4 Software on AIX Servers
Expertise in installing, configuring and troubleshooting on JS20 and HS20 Blades in IBM Blade center.
Expertise working in a huge environment that consists of almost 700 Servers including RS/6000, p-series and IBM Blade Center.
Experience in IBM AIX 5.1, 5.3 and 6.1, 7.1, Red Hat Linux 5.1, Suse Linux 10 and support on Windows Operating Environments.
Managing DNS, LDAP, FTP, Tomcat and Apache Web servers on LINUX (Redhat ES 3.0) servers.
Managing Automount, Netgroups, Secure NFS, Configuration and maintenance of Samba server, Migrating windows environment to Linux environment.
Responsible for Configuring VLANs on IBM Bladecenter, Nortel Switches, and CISCO switches.
Responsible and expertise in Configuring the Nortel and Cisco (Zigmo and Elmo) Switches for IBM BladeCenter.
Excellent capacity planning skills in UNIX AIX/Solaris environment
Performance Tuning and Capacity Planning and evaluating products in UNIX area
Engaged to assist with strategic planning, capacity planning, and performance tuning.
Extended knowledge in installing AIX in an LPAR environment pSeries including configuring VIOS
Maintain and use NIM Master for installs and upgrades. Plan and implement service updates
Expertise in Planning, Installation, Configuration of IBM HACMP v 5.1, 5.2, 5.3, 7.1 Including problem-solving and disaster recovery in detecting and reacting to failure events, allowing the system to stay available during random, unexpected software problems and also configured to react to hundreds of system events. Experience includes TCP/IP Networking Parallel System Sport Programs (PSSP) which supports best practices in HACMP - High Availability Clusters
Experience with Tivoli Workload Manager
Knowledge of setting up the Portal Clusters and WAS Clusters in both horizontal and vertical clustered environments for Work Load Management (WLM).
Configuration of Network Deployment manager for Centralized Management of Application Servers.
Experience in administering and maintaining Production/ Staging/ QA/ Development environments.
Experienced in Installing Fix Packs, cumulative fixes, and Interim-fixes.
Extensive Experience in optimization of Enterprise Applications using Websphere Application server 5.0/4.0/3.5, XML Config, Workload Management (WLM), WAS Resource analyzer, Websphere Test Environment (WTE), IBM Visual Age for Java 4.0/3.5, EJB, JNDI, LDAP, JMS, Oracle 9i/8i/7.x, DB2 UDB on Sun Solaris, AIX and Windows 2000
Coding experience in Java J2ee.
Experience deploying Java applications in Websphere Application Server.
Experience NIC bounding configuration in Linux and UNIX systems to increase the bandwidth or redundancy based on requirement by the application.
Education: Bachelor of Engineering in Information Technology
TECHNICAL SKILLS
Operation Systems
IBM AIX (4.3, 5.1, 5.2, 5.3, 7.1), Linux (Redhat,SUSE), Sun Solaris 2.5/2.6/7.0/8.0, HP-UX 11.0, 11.23, Windows 03/00/NT4.0
Languages
C, C++, Java 2.0/1.2/1.3/1.4
Application/Web Servers
WebSphere 6.0.2.x/5.1.1.x /5.0.2.x /4.0, WebSphere Portal Server 5.1.0.x
IBM HTTP server 6.0/2.0.42.x/2.0.47.1/1.3.28 /1.3.26/1.3, Apache 2.0.47/1.3.28.
Databases
Oracle 8i, 9i,10G, 10.1.0.2/9i, DB2UDB 8.1
Web Technologies
J2EE1.4/1.3/1.2, Java2.0, Servlet2.3/2.2, Java Beans, EJB2.1/2.0/1.1/1.0, JSP1.2/1.1/1.0, JDBC2.0/1.0, JNDI and shell Scripting.
Other skills
VIOS, HACMP 4.3.1, 4.4, HACMP/ES 4.5, 5.X, Samba, TWS
WORK EXPERIENCE:
Client: AIG Jan’14 till date
AIX/UNIX/LINUX System Administrator
Responsibilities:
The Project involves a great responsibility and a high level task with time constraint
DR site design, virtual implementation and setup.
Installation, migration, Configuration and Administration of AIX 5.1, 5.2, 5.3, 6.1 & 7.1.
Building of VIOS and VIO LPAR’s on p-Series 590, 570, 550 and 505 servers using HMC V6 (websm) later upgraded the HMC V6 to HMC V7 (GUI).
Extensively worked on Server Consolidation and Disaster Recovery
Decommissioned old frames and migrated servers on to each LPAR in high end p7 frames as part of consolidation strategy.
24x7 on call production support.
The Project involves a great responsibility and a high level task with time constraint
DR site design, virtual implementation and setup.
Building of VIOS and VIO LPAR’s on p-Series 590, 570, 550 and 505 servers using HMC V6 (websm) later upgraded the HMC V6 to HMC V7 (GUI).
Worked on the HACMP 5.4 version, failover the RG to the next node, start and stop the cluster services and HACMP
Supported to the Oracle cluster ware, stop and start the Oracle rac1 services and status check.
User Management - Creating, maintaining, and removing users and groups. Security settings on user accounts and groups.
Supported all the application servers in the environment consisting of various applications such as WebSphere, PeopleSoft, Message Broker, MQ Series, Oracle, RAC Oracle, DB2 and many home grown applications.
Installed Veritas clustering on Oracle and websphere server
Successfully performed the critical tasks of synchronizing the UIDs/GIDs on HACMP cluster nodes.
Set up the database emergency IDs for DB2, UDB and Oracle instances on all database servers.
Trouble shooting HACMP related issues, going through the log files Taking HACMP snap using snap utility and using snaps to recover HACMP topology in case of any disaster
Archived 7TB of data to TSM server then copied to tape drive and migrated to Missouri data center.
Maintaining the NIS user administration account
Running to the supporting Unix scripts for the application support.
Working on the errors on daily basis.
Working on Weekend Health check reports on all prod and PT servers.
Monitoring systems, cpu, memory and disk utilization.
Analysis the NMON data and observe the spikes of the system performances issues.
Defining shared volume groups and working on different operations such as creating sharedfile systems, increase or decrease file system sizes and adding disks to the volume groups.
Configuring system dump devices, taking system dump, estimating system dump, uploading the system vmcore files to IBM ftp site.
Troubleshooting from system performance related issues.
Handling the server hardware related issues with IBM CE & coordinate with the IBM CE for hardware replacement.
Using alternate disk installation method when upgrading or installing TL or ML on AIX Operating system.
Installation of emergency fixes and supporting fixes for the applications.
Troubleshoot the system boot related issues and corrupted filesystem by using fsck through maintenance mode.
Network configuration of TCP/IP & Ether Channelv(Ling Aggregation), online troubleshooting for network and system, ensuring connectivity between servers
Performed the HMC up gradation to 7.7.2 version.
Responsible for maintaining and administering 600 production IBM p770, 780, 590, 570, 550 and RS6000 AIX & UNIX based servers.
Responsible for installing configuring, migrating and maintenance of GPFS version 2.1 and 3.3
Managed and used NIM server to install, migrate and creating backups
Experienced on Peregrine Ticketing tool and solving P1/P2/P3/P4 tickets
Built VIO servers and VIO clients on POWER6, p5 P520, P550, P570 and p595s.
Installing and configuring LPARs, and VIO Server in pseries servers through HMC.
Created and configured dynamic VIO LPARs on p5-520, p5-550, p5-570 and p5-595
Adding, increasing the file system space in HACMP environment.
Setup HACMP clusters for high availability of servers and to face any unexpected outages.
Performed Installation and Configuration of NIM. Installed BOS, upgrades, migration of AIX on each node using NIM.
Included upgrading NIM master, alternate NIM master, creating the SPOT, lpp-source & mksysb NIM clients.
Developed and modified UNIX Shell scripts
Environment: IBM pSeries 550, 570,590, 595, AIX v5.2/5.3/6.1/7.1, VIOS, LPAR, HACMP V5.2/5.3/5.4, Windows 2000, Oracle 9i,Oracle 10g, Veritas Netbackup Java, DB2r, LVM, SSH, IBM BladeCenter JS22, FAS3100, FAS2000 storage devices, Tivoli, TSM, Weblogic, Web Sphere application Server. Red Hat, Linux
Client: CSGI Omaha NE Jan ‘12 till Dec’13
AIX/Unix Systems Engineer
The client had thousands of servers and I installed, configured, troubleshoot and decommissioned servers. Coordination with Database and Application teams was a key factor here. Respond to alarms/alerts on production and non-production servers. Taking care entire maintenance tasks which are schedule after clearance. Monitoring. Supporting and performed troubleshooting.
I was the prime admin during hardware migration for servers for p550, 570 and 595 to new created LPARS on p770 frames. Moving the servers from old Hardware to new hardware using the SAN disk migration process and using the downtime for the OS upgrade to AIX 710*-**-**-****.
Provided 24x7 on call production support to AIX and Linux Servers on a rotating shift schedule.
I was responsible for building five p770 frames (each of 4 CEC), installing VIOS, creating LPAR profile, performing all the powerVM operations, Installing OS, building NIM server, Security remediation and OS hardening, Upgrading HMC, system firmware and VIOS.
I was responsible for maintaining healthy work relation with different third party vendors involved into compliance/audit activities. This includes maintaining best industry standards in security and patches facilitate the POC necessary to evaluate security tools and provide inputs in decision making.
Activities include user administration; startup and shutdown scripts; crontabs, file system maintenance, backup scripting and automation using Perl, shell scripting (bash, ksh) for Red Hat Linux and Solaris systems.
Experience working with EMC SAN tools like SRDF, BCV and snaps for replication and backup purpose.
Implementation of VMware Infrastructure for Windows, SLES 11 & Linux Red hat 5.0 with VMware ESX 4.x,3.5, Virtual Center 2.5 and administered the VMs with VI client.
I was the admin for delivery of infrastructure projects like IBM frame build, vlun fixing, VIO upgrades, HMC upgrades, system firmware upgrades, change managements of production servers etc.
Responsible for Enterprise Decommission projects for AIX, Solaris, and Linux standalone and managed servers.
Decommissioned legacy AIX 4.3, and 5.3, on Power5 machines and AIX6.1
Decommissioned and coordinated with IBM for removal of IBM P5 9117-570, P5 595.
Provided on call production support to AIX and Linux Servers for second shift schedule.
Upgraded servers AIX 6.1 TL8 SP3 to AIX 7.1 TL 2 and TL6 SP3.
Monitored the servers using Nagios regularly and performed troubleshooting.
Installation/administration of AIX, Linux, Solaris, and NT/2000 Servers on a LAN, setting up optimal RAID levels (fault tolerance) for protected data storage in NAS environments. Install and configure DHCP, DNS (BIND, MS), web (Apache, IIS), mail (SMTP, IMAP, POP3), and file servers.
Edit system configuration files (network settings, service configuration files, cron)
Provide day to day support by using Ticketing system.
Demonstrate technical knowledge with incident handling and troubleshooting.
Few of the skill sets are listed below
Hardware Migration - I was the prime admin during hardware migration for p550,570 and 595 to new created LPARS on p770 frames, installation, reconciliation and upgrade of OS and IOS, upgrade of HMC and system firmware, supported critical application complication and troubleshoot the root cause and provided solution/assistance to applications and Databases queries.
Upgrade – I have upgraded HMC, system firmware and VIOS to meet the challenge of dynamically editing of Ethernet virtual adapters (for VLAN) on power7 p770 servers. It was carried out on all frames and documented for onsite and offshore team for future references.
Virtualization - Independently built, configured and upgraded VIO servers to implement virtual HBA (NPIV) shared SCSI, shared Ethernet adapters, VLANS, allocating disks via VIO servers to client LPARs. Installed and upgraded HMC, upgraded system firmware. Created workload partitions for applications.
NIM Administration - Multiple NIM servers for managing hundreds of client LPARs. NIM OS upgrade, mksysb of the client LPARs, different types of NIM resources, client definitions, multiple VLANs to use on NIM server for OS installation operation. Migration of OS using NIMADM, CD/DVD and rte boot. Restoring the mksysb (operating system) from NIM server (Network boot).
Monitoring - The management was particular about the performance, I have analyzed data and generated reports using BMC capacity management, HP open view and nmon, I have used the web based method for nmon to monitor the system performance statistics online.
Customer Facing and Team Player - Actively participated in discussions with client management team to understand their infrastructure needs and worked on technical proposals to meet them effectively and in time. Represented UNIX team to customers and helped to achieve the SLA in time.
Other Responsibilities - Creating, expanding the file systems, adding disks into cluster, creating shared disk groups, troubleshooting performance issues of various natures, supporting application teams to install the patches, User administration, Server move, deployment, attending meetings, and participating in interviews for new team members.
Kaiser Permanente, CA Sep 2009 – Dec 2011
UNIX AIX Sys Admin
Responsibilities:
Provided 24x7 on call production support to AIX and Linux Servers on a rotating shift schedule.
I was responsible for building five p770 frames (each of 4 CEC), installing VIOS, creating LPAR profile, performing all the powerVM operations, Installing OS, building NIM server, Security remediation and OS hardening, Upgrading HMC, system firmware and VIOS.
I was responsible for maintaining healthy work relation with different third party vendors involved into compliance/audit activities. This includes maintaining best industry standards in security and patches facilitate the POC necessary to evaluate security tools and provide inputs in decision making.
I was the admin for delivery of infrastructure projects like IBM frame build, vlun fixing, VIO upgrades, HMC upgrades, system firmware upgrades, change managements of production servers etc.
Responsible for Enterprise Decommission projects for AIX, Solaris, and Linux standalone and managed servers.
Decommissioned legacy AIX 4.3, and 5.3, on Power5 machines and AIX6.1
Decommissioned and coordinated with IBM for removal of IBM P5 9117-570, P5 595.
Reclaimed SAN storage from the VIOS for decommissioned servers.
Reclaimed SAN storage for LUNs directly presented to the lpars, worked on troubleshooting issues for IBM, EMC, Hitachi SAN disks.
Decommissioned NAS shares.
Built and setup dual VIO servers with NPIV – Virtual Fibre Channel.
Created Shared Ethernet Adapter (SEA) with Control Channel adapter.
Worked as a UNIX security consultant in the Identity Access Management (IAM) team maintaining IAM software on the infrastructure servers which consisted of AIX 5.2,3, 6.1, 7.1, Solaris 9, 10 and Linux 5.x servers.
Developed and managed the servers inventory (all UNIX servers and HMCs) in excel sheet with regular updates.
Responsible for information security analysis on all UNIX servers which includes UNIX user accounts, group access, elevated access, file ownership and file permissions.
Created and managed bulk users and groups as part of regular work.
Expertise in SSH key set up process.
Generated SSH keys and set up SSH connection between UNIX, UNIX-windows and UNIX-Mainframe servers.
Worked on Power Broker/Power Password software for SOX compliant servers (500+ prod/non-prod servers)
Supported PB/PP SOX servers (including HACMP cluster) for any provisioning/synchronization issues.
Working knowledge of Active Directory.
Worked on Quest Authentication Services (QAS) software and Active Directory for centrally managing the user/group access control on UNIX servers (Single Sign On).
Expertise in Remedy ticketing system since each and every task is done via Remedy ticketing system.
Prepared and maintained documentation for user/group provisioning and sudo configuration on all servers in scope.
Responsible for managing the elevated access for users and groups by configuring/maintaining the sudoers file.
Maintain and support Quest Authenticating Services(QAS) and Power Broker/Power Password software for centralizing user management and privilege access control on the infrastructure servers which consists of AIX 5.1, 5.2, 5.3, 6.1, 7.1, Solaris 8,9,10,Linux 5.2,5.4, and Linux
Worked closely with database, websphere, SAS and MQM teams on UNIX provisioning and elevated access.
Collaborate with technical peers to identify root cause of access and/or security issues.
Work directly with the business/application-side customers to remediate UNIX access and/or security issues.
Shell Scripting:
Responsible for automating the regular day to day work as much as possible.
Developed UNIX shell scripts, to automate the User/Group creation/deletion, performance monitoring, password generation, and setup and maintenance procedures.
Wrote a shell script for UNIX account and group provisioning on AIX, Linux and Solaris servers
Wrote a script to identify and delete terminated users and their home file systems from 4000+ servers
Wrote a shell script to push SSH keys and set up proper file permissions/ownership from one jump server to all platform servers.
Wrote a shell script for a daily cronjob which collects the passwd, group and sudoers file from 4000+ servers and stores them in a special and easy to access format.
Worked on shell script to create users according their role on 120+ HMC (Ver. 3,5 & 7)
Managed HMCs
Locked down “hscroot” account on all HMCs (not shared) and instead created user accounts based on the user roles (superadmin or viewer).
Set up SSH keys on all HMCs.
Managed passwords for all users on 120+ HMCs
Participated in company’s exclusive internal process to picture UNIX security department’s current process and to draw a road map to improve the current process.
Helped technical writer to prepare the SOP document for UNIX department.
Prepare any new required documentation and maintain and update the existing documentation for user/group provisioning, elevated access and other processes/procedures on SharePoint site.
Client: Bank of America, TX Aug 2007 – Aug 2009
AIX UNIX Sys Admin
Responsibilities:
Support of IBM P-series, Hardware setup and configuration, AIX OS installation/Migration/Cloning/Decommissioning PTF installation and management, Disk subsystem configuration, Filesystem and logical volume planning and configuration, VERITAS volume manager, Performance monitoring, I/O tuning, User and printer management, Inittab and Cron management, HACMP and LAAM clustering, LPAR and DLPAR installation Network maintenance, A sync and Serial communication configuration, System backup and restore, Daily security checks, Third party software installation and upgrades, scheduled system health checks, Perl and shell scripting, S.A. procedure documentation, New system planning, Customer support, System related problem determination and resolution.
Responsible for Installation, Configuration Management, Maintenance and Systems Development of AIX Systems.
AIX administration supporting p590, 570, 550, 520 RS6000 Servers, installing, configuring and maintaining Websphere Application Server, Samba Server and IBM HTTP Server.
Expertise in doing NIM installations on AIX 5.2/5.3/6.1
responsible HACMP cluster environment with cascading
Responsible for LPAR and DLPAR system administration
Installed VIO server Advanced POWER Virtualization on IBM P5 System.
Installation and configuration of the security software POWER Broker and POWER Password for SOX Compliance.
Support and troubleshoot while installing POWER Broker and POWER Password.
Sudo environment, given sudo right to limited directories for Websphere admin to perform thr task.
Edited Sudoer script, added Oracle DBA and Websphere Admin to sudoer’s list limiting there access to specific directories to perform the task
Installed Symark products (Power Broker and Power Password) on both production and non-production servers (AIX 5.1, 5.2, 5.3, 6.1) in an NIM environment., in a HACMP cluster scenario.
Expertise in installation configuration and administration VIOS
Responsible in configuring of virtual Ethernet, virtual SCSI and virtual memory
Responsible and expertise in working with LVM, Disk mirroring, unmirroring, Disaster Recovery, backup and
restore for AIX 4.3/5.2/5.3/6.1
Installed and build from scratch complete NIM Setup. Added different clients to NIM server and their Backup.
Installed VIO server Advanced POWER Virtualization on IBM P5 System.
Predefined and Customized Volume Group management on AIX.
Software and Hardware upgrades of AIX systems installed and worked on various Volume managers.
Day to day System Administration tasks recovering failed hardware and software problems. Monitoring the errors configuring syslogd daemons and working on led error on different boxes.
Executed various scripts for backups, user account creation on multiple servers, to ping multiple servers, login in to multiple servers, to locate servers etc.
Executing scripts to create user account of multiple servers
Developed shell scripts to check the available and active paths to each lun on servers.
Developed shell scripts to check default gateways available on each server
Edited rc.shutdown script to add shutdown script of Websphere application server and Oracle Database and edited server startup script to add the startup script of Websphere application server and Oracle Database.
Coordinated for deployment of Java applications on WAS.
Environment: AIX 5.2/5.3/6.1, VIOS, HACMP, Linux, HPUX, Solaris. LPAR, Websphere application server 6.0, UNIX Shell scripting
Contact this candidate