Big Data Platform Engineer

Job Description

Who We Are.

At CMIT, we do more than provide real-world solutions. We deliver transformative results. Through cutting-edge technology and process innovations, we are changing how federal and commercial clients worldwide deliver their mission. A service-disabled veteran-owned small business, we take pride in serving our nation through exemplary support for our clients and employees alike.

BIG DATA PLATFORM ENGINEER

DCSA is taking steps to strengthen its position as a key provider of cloud-based and big data services to various Consumers. Transformation of its large-scale Big Data infrastructure is a key element of the overall information technology strategy. The Big Data Platform is comprised of an integrated set of platform technologies that provide industry-leading data persistence and analysis capabilities. As a member of the infrastructure team, the Senior Big Data Platform Engineer will play a significant role in helping DCSA transform its Big Data ecosystem that supports applications including Data Analytics Services and other key initiatives.

This telework position is fully remote with occasional travel to the client worksite.

Responsibilities

Deploy, configure, upgrade, and sustain the development, testing, and production of BDP environments.

Work with the applications team to deploy and upgrade applications running on the Big Data Platform.

Provide subject matter expertise to the organization and will perform hands-on engineering and configuration tasks in complex, interdependent environments, and will lead triage, diagnosis, and remediation of platform-related issues.

Work with our key partners and industry peers to understand and influence industry technical direction in order that big data requirements are accommodated.

Education/Certification Requirements

High School diploma or equivalent education

DoD 8570 compliant IAT Level 2 baseline certification (e.g., CCNA-Security, CySA+, GICSP, GSEC, Security+ CE, CND, or SSCP)

Required Qualifications

9+ years (or commensurate experience) of demonstrated expertise in technology selection, architecture design, engineering and configuration, deployment, operational support, and issue resolution.

Full stack technical expertise from OS and configuration management through to Big Data ecosystem components such as:

Data processing and streaming analytics using Kafka and Storm

Platform management plan using RDAs, Containers, Consul, and Airflow

Data storage and analytics using Hadoop with YARN, Accumulo, and Apache Spark

Manage user accounts and authentication using Citadel, Kerberos, LDAP, and SAML

Proxy services using NGINX

Deployment automation and configuration management using Puppet and Ansible

Expertise with integration and administration of PostgreSQL databases

Experience operating in an AWS Cloud environment, including administration of EC2 resources, and understanding of key networking concepts such as VPC, subnet, and security groups.

Understanding of storage concepts such as EBS volumes and S3.

Strong understanding of security vulnerability detection and remediation using ACAS and DISA STIGs.

Strong understanding of various encryption technologies.

Strong experience in Linux-based scripting and systems administration.

Demonstrated ability to develop sizing and capacity planning for large-scale big data platforms and to periodically evaluate and optimize performance and platform throughput.

Excellent communications skills, including the ability to handle detailed technical communications and distill complex technical details into executive-level oral and written communications.

Preferred Qualifications

Cloudera Certified Data Engineer (CCDE) certification

Hortonworks Certified Associate (HCA) certification

AWS Certified Big Data - Specialty certification

Experience with Atlassian tools such as Jira and Confluence

Experience working in an Agile Framework environment

Clearance Requirement

Active Secret clearance

Who Makes It Happen.

At CMIT, we firmly believe that our innovative solutions are only as powerful as the teams harnessing them. Our people are more than just contributors - they are at the heart of everything we do and every success that we earn. Our employees are offered ample options to design a personalized benefits package that best meets their needs. Options include:

Medical / Rx

HSA / FSA

Dental & Vision

Life / AD&D

Long & Short Disability

Disability Insurance

Accident Insurance

Critical Illness

Hospital Insurance

Pet Benefits

Education/Training Program

401k Retirement

Generous Paid Time Off

Flexible Parental Leave

Volunteer Time Off

Flexible Work Locations

Alternative Work Schedules

CMIT provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

COVID-19 Safety Protocols: To protect the health and safety of its employees and to comply with customer requirements, employees in certain positions may be required to be fully vaccinated against COVID-19 or subject to facility entry safety protocols (e.g., testing, masking, physical distancing), subject to the status of the federal contractor mandate and customer site requirements.