YURIY PETYUK – SRE, BIGDATA ADMIN, DEVOPS
Cloudera Certified Administrator for Apache Hadoop (CCAH) License 100-014-679 Microsoft Certified: MCP, Azure Fundamentals
Toronto, Canada E-email: *.*****@*****.*** cell: +1-647-***-**** SUMMARY
LinkedIn profile - https://www.linkedin.com/in/yuriy-petyuk/
• BigData/Hadoop Admin/Architect, DevOps, Unix/Linux System Administrator with over 20 years of professional experience in IT industry from network/communication engineering, application support, Unix/Linux System Administration up to Big Data support, DBA(ScyllaDB) and IT Project Management
• Supporting/installing/tuning Big Data Hadoop Dev/Prod clusters based on CDP and HDP/HDF
• Experience troubleshooting oozie WFs and debugging Hadoop applications
• Supporting/installing/tuning ScyllaDB clusters
• Experience in integrating Azure Defa Factory services with on Prem Hadoop
• Supporting/installing/tuning Kafka Dev/Prod clusters
• DevOps experience building secured Hadoop Big Data clusters based on Cloudera & Hortonworks with Ansible
• Experience in automation deployments with Ansible and Ansible Tower of Hadoop environments
• Excellent understanding of UNIX/Linux operating systems and architecture, Client/Server technology, telecommunications and network engineering
• Performed system problem determination procedures including running diagnostics, analyzing error logs and troubleshooting
• Experience supporting Oracle WebLogic
The last achievements:
- Web UI to monitor Ozzie workflows
Skills and Awards:
• Hadoop: Hortonworks & Cloudera CDP & distributions, Kafka, Hive, HBase, NiFi, etc.
• Security/Auth: MIT Kerberos, Centrify, Ranger
• CICD: Jenkins, Ansible, Ansible Tower
• Tools: Jira, Git, Oracle SQL Developer, Apache Directory Studio, Confluence
• Operating Systems: Unix, Linux, MacOS, MS Windows, Red Hat Enterprise Linux 6,7,8
• Databases: MariaBD/MySQL, ScyllaDB(Cassandra)
• Programming languages: Linux shell, Python, Java, JavaScript
• Cloud: Azure Data Factory and Azure Databricks, Google Cloud
• Oracle WebLogic
2
WORK EXPERIENCE
June-2019 – Present – SRE, Hadoop Admin/Architect, Platform Engineer, Toronto, Canada - contractor Projects: AT&T, Rogers Communications, RBC, Bell
Responsibilities:
• Designing/supporting/maintaining/upgrading secured Hadoop Big Data clusters based on Cloudera CDP and HDP/HDF
• Connectivity for Azure Big Data applications (ADF, Databricks) to on-premises Hadoop clusters
• Troubleshooting Big Data application issues (Java, Spark, pySpark)
• Tuning HDP/CDP/HDF clusters for the best performance
• Assisting QA/Dev teams in troubleshooting environmental and application issues
• Supporting/installing/tuning ScyllaDB Dev clusters
• Assisting cloud admins in configuring connection from cloud to on-premises HDP/CDP clusters
• Maintaining security for HDP/CDP clusters with Ranger, RedHat IDM and Kerberos
• Supporting/installing/tuning Kafka Dev/Prod clusters
• Supporting Azure Data Factory and Azure Databricks Environment: Hadoop - Cloudera CDP7, Hortonworks HDP, Cloudera Manger/Ambari REST API; RedHat - Enterprise Linux, Identity Management LDAP, Virtualization; MS AD; CentOS/RedHat/Ubuntu Linux; Azure Data Factory and Azure Databricks; MIT Kerberos; Java; Python; bash scripting, TCP/IP; DNS; Firewalls; Docker; Jenkins; Nexus; GitLab; NetApp; Puppet; ServiceNow; MacOS; Jira; Confluence Feb-2015 – May 2019 - Big Data Admin, Hadoop Platform Engineer, Luxoft, Kiev, Ukraine Project: AT&T/DirecTV
Tasks performed:
• Supported and maintained secured Hadoop Big Data clusters
• Installed and supported in-house Cloudera Hadoop environments for developed applications
• Installed and supported in-house Hortonworks Hadoop environments for developed applications
• Assisted teams in troubleshooting environmental and application issues (Java, Spark, pySpark)
• Deployed a highly available and scalable system infrastructure based on Cloudera & Hortonworks Hadoop distributions
• Supporting/installing/tuning Kafka Dev/Prod clusters Environment: Hadoop - Cloudera CDH5, Hortonworks HDP, Cloudera Manger/Ambari REST API; RedHat - Enterprise Linux, Identity Management LDAP, Virtualization; MS AD; CentOS, Ubuntu Linux; MIT Kerberos; Python; bash scripting, TCP/IP; DNS; Firewalls; Docker; ServiceNow; MacOS Dec-2011 – Jan-2015 - Unix/Linux Admin, Work Order Manager, GlobalLogic, Kiev, Ukraine Project: British Sky Broadcasting
Tasks performed:
• Reviewed, prioritized and resourced work orders that were submitted to a team of systems engineers
• Managed service requests, work orders and task ticketing systems 3
• Managed e-mail communications and telephone enquiries relating to work orders
• Managed all requests for work and made sure that the customer expectation was deliverable with the resources available
• Made sure that all required information was available to allow the work to be delivered on time and to the customer satisfaction
• Assisted in release management meetings and CABs (Change Advisory Board) Environment: RedHat/CentOS Linux; Sun/Oracle Solaris; TCP/IP; DNS; Firewalls; VMware; Apache Tomcat; nginx; Python; Nagios; HP Open View; SAN; NFS; Apache HTTPD; LDAP; ServiceNow; Jira Feb-2010 - Nov-2011 - Unix/Linux Admin, Global Logic, Kiev, Ukraine Project: British Sky Broadcasting
Tasks performed:
• Was in charge of Data Administration of corporate Linux and Unix servers: installed, upgraded, and maintained UNIX operating systems
• Performed level 3 troubleshooting and resolution of application and system related problems
• Performed system software upgrades including planning / scheduling, testing, coordination and maintaining integrity of the operating system environment
• Monitoring systems (Opsview, Nagios)
• Worked on Data Center maintenance (servers' hardware, racks), Virtualization infrastructure administration (VMWare vSphere, ESXi)
• Wrote and maintained documentation for responsible areas Environment: CentOS/RedHat/Ubuntu Linux; Sun/Oracle Solaris; TCP/IP; DNS; Firewalls; VMware; Tomcat; nginx; Python; Nagios; HP Open View; SAN; NFS; Apache HTTPD; LDAP EDUCATION
Master’s degree in Engineering, National Technical University of Ukraine “Kyiv Polytechnic Institute” Trainings and Certifications:
• Certified AZ-900: Microsoft Azure Fundamentals
• Cloudera Certified Administrator for Apache Hadoop (CCAH) License 100-014-679
• Kafka and Ansible courses
• Certified Unix/Network Administrator for Sun Solaris
• Hortonworks courses for Hadoop Cluster Administration
• Mastering Hadoop Cluster Administration courses
• Python, Java, JavaScript courses
INTERESTS
Falun Dafa (also called Falun Gong) is an advanced self-cultivation practice of the Buddha School. Falun Dafa was founded by Mr. Li Hongzhi, the practice's master. It is a discipline in which
“assimilation to the highest qualities of the universe—Zhen, Shan, Ren (Truthfulness, Compassion, Forbearance)—is the foundation of practice. More info - https://falundafa.org/