Lead Data Engineer

Job Description

540 is seeking a Lead Data Engineer to own the technical direction of mission-critical, cloud-based data platforms supporting high-impact federal missions.

In this role, you'll lead the architecture and implementation of scalable data pipelines in AWS, set engineering standards, and act as a technical mentor across teams, while remaining deeply hands-on in building and evolving our data infrastructure. This is an opportunity for a senior engineer who thrives at the intersection of architecture, execution, and mentorship and wants to build modern data solutions that matter.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3-4x annually)

Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance

Education Requirement: Bachelor's Degree in Computer Science or related engineering field (preferred)

540 Internal Thrive Level: Senior Software Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don't just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU'LL DRIVE IMPACT

Lead the design and implementation of enterprise-scale data pipelines and ETL processes in AWS environments

Provide technical leadership and architectural guidance to cross-functional engineering teams

Drive best practices for data modeling, pipeline optimization, and cloud infrastructure design

Architect and implement solutions using Python, AWS Lambda, and modern data engineering frameworks

Oversee code quality, conduct architectural reviews, and establish engineering standards

Collaborate with stakeholders to translate complex business requirements into technical solutions

Mentor and develop junior and senior engineers through code reviews and technical guidance

Troubleshoot and resolve complex data engineering challenges across the technology stack

Stay current with emerging technologies and recommend innovative approaches to data challenges

REQUIRED SKILLS & EXPERIENCE

9+ years of professional experience in data engineering or related technical roles

Demonstrated experience as a technical lead or architect on complex data projects

Expert-level proficiency in Python programming and software engineering best practices

Deep understanding of AWS services including Lambda, S3, Step Functions, Glue, EMR, Redshift, and related data tools

Strong experience with Git version control and collaborative development workflows

Proven track record of designing and implementing scalable, high-performance data solutions

Experience with data warehousing concepts, dimensional modeling, and analytics platforms

Strong understanding of CI/CD pipelines and infrastructure-as-code principles

Excellent communication skills with ability to explain complex technical concepts to diverse audiences

Currently possess or be able to obtain within 30 days of hire:

AWS Cloud Practitioner certification (or higher)

CompTIA Security+ certification (or higher)

NICE TO HAVE

Familiarity with X12/MILS processing

AWS certifications (Solutions Architect, Data Analytics, or similar)

Background in Agile/Scrum development methodologies

Experience with containerization technologies (Docker, ECS, EKS)

Familiarity with data governance and security best practices

BENEFITS & PERKS

Flexible PTO + all Federal holidays off

Health, dental and vision insurance plans

Flexible Spending Account (FSA)

401k with employer match

Company-sponsored life insurance, short- and long-term disability

Professional development (training, certifications, conferences)

Paid cloud developer accounts

Referral bonuses

HQ office perks (parking / metro reimbursement, nitro coffee & lunches)

Annual social events (540 Week, hackathon, charity golf tournament, etc.)

Access to 540's Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Full-time

Fully remote