Data Engineer

4301 Data Engineer

4301 Top Secret

Job Description:

OVERVIEW:

We are seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources.

GENERAL DUTIES:

Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains

Architect and develop ETL workflows for highly sensitive data in classified environments

Support IC Data Services requirements by integrating various intelligence data sources and systems

Develop and maintain data analytics solutions for desktop and web-based visual analytic applications

Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data

Design strategies for enterprise database systems and set standards for operations, programming, and security

Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)

Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability

Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets

Integrate new systems with existing warehouse structures and refine system performance and functionality

Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices

Provide technical leadership and mentorship to other team members

Participate in Program Increments (PIs) and Agile Release Train (ART) activities REQUIRED QUALIFICATIONS:

Bachelor's degree in Computer Science, Data Science, Engineering, or related field

Minimum of 10 years of experience in data engineering or related field

Experience with SAFe Agile framework

Strong understanding of forensic and investigative data requirements

Demonstrated experience designing and implementing data solutions in secure government environments

Advanced proficiency with

Python for data processing, automation and ETL workflow orchestration

SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization

Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)

Data pipeline technologies (Apache Nifi, Cribl)

Cross-domain ETL solutions for secure data transfer between classification levels

Containerization and orchestration technologies (Docker, Kubernetes)

Cloud platforms (AWS GovCloud, SC2S, C2S)

Experience handling data in accordance with IC security protocols and classification guidelines

IC Data Services frameworks and integration protocols

GraphQL: schema design, API development, query optimization, and integrations

DevSecOps practices and tools in classified environments

RabbitMQ and Redis DESIRED QUALIFICATIONS:

Experience with Intelligence Community Data Services and standards

Prior work with cross-domain solutions for ETL processes

Knowledge of IC specific data formats, schemas and transfer protocols

Experience with specialized IC analytics platforms and data repositories

Prior work integrating intelligence data across multiple enclaves

Cloud certification CLEARANCE:

Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)

Job Details

City : Chantilly

State : Virginia