Data Engineer

BT-66 Data Engineer

Skill Level: Senior

Location: Herndon/Chantilly (fully on-site, no remote option)

**MUST HAVE A POLY CLEARANCE TO APPLY**

We are seeking a Senior Data Engineer to develop tools, code, and services for data engineering activities involving structured and unstructured data. Responsibilities include:

Movement of data using approved methods

Executing data ingestion activities

Developing code to format data for exploration

Analyzing source data formats and collaborating with Data Scientists and partners

Creating code and tools for data extraction, formatting, and transformation

Developing and maintaining ETL processes and documentation

Design and optimize data pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR, NiFi, and Kubernetes. Ensure data pedigree, quality, and security, and collaborate with teams to enhance data standards and derive actionable insights. Required Skills:

10+ years of experience in data lifecycle engineering

Development and maintenance of ETL tools and services

Experience with cloud and on-premises data storage and processing

Proficiency in Python, SQL, Spark, and other data engineering programming

Experience with COTS and open-source tools like ElasticSearch and NiFi

Experience working within the Agile lifecycle

Applicants must:

Reside within Virginia, Maryland, or DC

Have an active Poly clearance

Specify their Poly type and the date granted

Indicate preferred on-site location

*Note: This position is fully on-site with no remote work options. #J-18808-Ljbffr