Data Platform Engineer

Data Platform Engineer

W2 Contract

Salary Range: $119,600 - $140,400 per year

Location: Cupertino, CA - Remote Role

Job Summary:

We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, and Hadoop. You will effectively partner with upstream engineering teams and downstream analytical and product consumers.

Requirements and Qualifications:

10+ years of experience; 5+ years designing and implementing batch or real-time data pipelines

Hands-on experience in batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)

Experience in AWS and knowledge of its ecosystem. Experience in scaling and operating Kubernetes.

Excellent communication skills are a must; experience working with customers directly to explain how they would use the infrastructure to build complex data pipelines.

Proven ability to work in an agile environment, flexible to adapt to changes

Able to work independently, research on possible solutions to unblock customer

Programming experience in Scala, Java, or Python is preferred.

Fast learner and experience with other common big data open source technologies is a big plus.

Knowledge of Machine Learning is preferred.

Desired Skills and Experience

Spark, Presto, Hive, Flink, Beam, AWS, Kubernetes, Scala, Java, Python, big data, data pipelines, Machine Learning

Bayside Solutions, Inc. may collect your personal information during the position application process. Please reference Bayside Solutions, Inc.'s CCPA Privacy Policy at