Staff Software Engineer - Datalake

Be Part of Building the Future

Dremio is The Easy and Open Data Lakehouse, providing self-service analytics with data warehouse functionality and data lake flexibility across all of your data. Dremio increases agility with a revolutionary data-as-code approach that adopts Git concepts to enable data experimentation, version control, and governance. In addition, Dremio breaks down data silos by simplifying ingestion into the lakehouse, and also allowing queries directly on databases and data warehouses. All of this is available through a fully managed service that not only eliminates the need to maintain infrastructure and software, but also automatically optimizes the data in the lakehouse to maximize performance for every workload.

Founded in 2015, Dremio is headquartered in Santa Clara, CA. Investors include Cisco Investments, Insight Partners, Lightspeed Venture Partners, Norwest Venture Partners, Redpoint Ventures, and Sapphire Ventures. For more information, visit Connect with Dremio on GitHub, LinkedIn, Twitter, and Facebook.

If you, like us, say “bring it on” to exciting challenges that really do change the world, we have endless opportunities where you can make your mark.

About the role

We are looking for an experienced Staff Software Engineer to enhance Dremio’s data warehouse capabilities on top of the datalakes across all major table/file formats and object stores. These capability advancements will increase our competitive position in the market and enable Dremio adoption for a larger set of customers.

What you’ll be doing

Develop core components for Dremio’s Datalake engine

Deliver key features and feature enhancements for our customers in the Datalake like DML operations, time travel, schema evolution along with performance and reliability improvements

Work with open source projects like Apache Iceberg, Parquet, Arrow and Calcite

Own design, implementation, testing, and support of next-generation features related to scalability, reliability, robustness, and performance of the product

Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment

Solve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficient

What we’re looking for

PhD/M.S./B.S. in Computer Science or related field

8+ years of experience developing production-level software

Fluency in Java, C++ or another general-purpose programming language

Strong database fundamentals and understanding of distributed systems internals

Excellent communication skills and the ability to work well in a team environment

Bonus points if you have

Hands-on experience with distributed query engines, query processing or optimization, distributed systems, concurrency control, data replication, code generation, or storage systems (e.g., Hadoop, Spark, etc.)

Experience with Apache Iceberg, Delta Lake, Hive, AWS Glue, Parquet

Understanding of distributed file systems such as S3, ADLS, or HDFS

Hands on experience with AWS, Azure and Google Cloud Platform

#LI-JW1 #LI-Remote

What we value

At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.