As a Sr.
Data Engineer I, you'll work with team members to build, deploy, and operate data pipelines and data engineering components to enable data brokering and exchange capabilities across a diverse range of producers and consumers.
In this role, you will be responsible for building robust, scalable data pipelines while working collaboratively with cross-functional teams to ensure seamless integration, optimized performance, and efficient delivery of solutions.
What you'll do: * Work with team members to operationalize data pipelines and supporting cloud infrastructure * Collaborate with external data producers and consumers to obtain and provide data through interfaces such as REST APIs and S3 * Provide day-to-day support of deploying Python-native data pipelines and performing data engineering tasks to enable data brokering and exchange capabilities * Provide Tier 2/3 troubleshooting and incident resolution support for data pipelines in Production What you'll need to succeed: * Active TS/SCI with CI poly required * 4+ years of proven experience in data engineering, with expertise in designing, developing, and maintaining data ingestion, transformation, and loading pipelines and components * Demonstrated experience in designing and deploying data pipelines leveraging AWS cloud infrastructure across multiple classification domains (e.g., IL5 to IL6+) * Experience with Infrastructure-as-Code (IaC) tools, including Terraform, CloudFormation, or Ansible, to automate deployment of data pipeline cloud infrastructure * Understanding of RMF security principles and hands-on experience implementing security controls for data pipelines in cloud environments * Strong scripting and programming skills in languages such as Go, Python, and Bash * Experience with data pipeline tools and technologies such as Nifi, Hadoop, HDFS, and Kafka.
Experience implementing data pipelines in the Cloudera Data Platform environment is highly preferred.
* Strong communication skills, with the ability to clearly convey complex technical concepts SALARY RANGE: $126,000 - $197,000 The salary range for this position is determined based on qualifications, skills, and relevant experience.
The final salary offered will be determined based on several factors including: * The candidate's professional background and relevant work experience * The specific responsibilities of the role and organizational needs * Internal equity and alignment with current team compensation * This role is also eligible for additional compensation, subject to the terms and policies of MetroStar, which may include: * Performance-based bonuses * Company-paid training and/or certifications * Referral bonuses