Software Engineer - Data Platform

Role: Software Engineer - Data Platform

Location: Palo Alto or Seattle

Salary Range: $154,000 to $297,000 + Equity

_

Who we are:

X serves our community of users and customers by working tirelessly to preserve free expression and choice, create limitless interactivity, and create a marketplace that enables the economic success of all its participants

We value:

Highly motivated individuals, focused on engineering excellence

Prioritizing impactful coding over extensive documentation

Focusing on delivering products and platforms, not just discussing roadmaps

If this sounds like you, let’s talk.

What you will do:

The Data Platform team is responsible for developing and managing a distributed data processing platform. Our focus areas include Apache Kafka, Spark, Flink, and Trino, along other supporting technologies. Our team tackles complex, impactful challenges at Petabyte scale. We develop vital platform components enabling ML and product teams to efficiently transport, process, and manage data at petabyte-scale.

As a software engineer in our team, you will:

Design and develop core functionalities in data ingestion and processing

Enhance and optimize Kafka and other transport layer technologies for real-time processing

Work closely with other engineers to ensure that our data platform is available, secure, and reliable

Uphold service quality throughout the software development lifecycle

Drive continuous improvement in our software solutions

Qualifications:

We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact. The ideal candidate will have:

Minimum 2+ years of backend development experience

Proficiency in languages like Java, Scala, Python, Rust

Experience in optimizing distributed data processing systems (Spark, Flink, Kafka, Hadoop, Storm) is highly desirable

Knowledge of ETL processes and data warehousing

Demonstrated experience building data pipelines

Independent learning capabilities for new technologies

Extremely committed, willing to work in a fast paced environment

Excellent communication and interpersonal skills

At X, our small but fast-paced team values innovation, creativity, and a strong commitment to our mission. As a Data Platform Software Engineer, you'll have the opportunity to make a significant impact on the future of X and our aspiration to build the Everything App.

If you're an exceptional engineer who shares our passion for freedom of speech, we'd love to hear from you.

R100076