Senior Software Engineer (Python Distributed systems)

1 week ago Be among the first 25 applicants

About The Company

At Scribd (pronounced scribbed), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our four products: Everand, Scribd, Slideshare, and Fable.

We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.

When it comes to workplace structure, we believe in balancing individual flexibility and community connections. Its through our flexible work benefit, Scribd Flex, that employees in partnership with their manager can choose the daily work-style that best suits their individual needs. A key tenet of Scribd Flex is our prioritization of intentional in-person moments to build collaboration, culture, and connection. For this reason, occasional in-person attendance is required for all Scribd employees, regardless of their location.

So what are we looking for in new team members? Well, we hire for GRIT. The textbook definition of GRIT is demonstrating the intersection of passion and perseverance towards long term goals. At Scribd, we are inspired by the potential that this can unlock, and ask each of our employees to pursue a GRIT?ty approach to their work. In a tactical sense, GRIT is also a handy acronym that outlines the standards we hold ourselves and each other to. Heres what that means for you: were looking for someone who showcases the ability to set and achieve Goals, achieve Results within their job responsibilities, contribute Innovative ideas and solutions, and positively influence the broader Team through collaboration and attitude.

About The Team

The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high-quality metadata to enable content discovery and trust for millions of users worldwide.

Our systems operate at massive scale, supporting diverse datasets like user-generated content (UGC), ebooks, audiobooks, and more. We work at the intersection of machine learning, data engineering, and distributed systems, collaborating closely with applied research and product teams to deploy scalable ML and LLM?powered solutions in production.

Role Overview

Were seeking a Senior Software Engineer with deep experience building event?driven, distributed, and scalable systems in Python. In this role, youll design and optimize large?scale data and service pipelines running on AWS, supporting Scribds content enrichment and metadata systems. Youll work closely with cross?functional teams to design reliable backend services that integrate machine learning models and LLM?based components when needed. This role offers the opportunity to work on cutting?edge generative AI and metadata enrichment problems at a truly global scale.

Tech Stack

Our backend systems are primarily built in Python, leveraging AWS services such as Lambda, ECS, SQS, and ElastiCache for event?driven and distributed processing. We also use Airflow, Spark, Databricks, Terraform, and Datadog for orchestration, data processing, and observability.

Key Responsibilities

Provide technical leadership, mentorship, and guidance to engineers across the organization, driving secure coding best practices.

Lead the design, implementation, and scaling of event?driven, distributed systems to extract, enrich, and process metadata from large?scale document and media datasets.

Partner with Data Science, Infrastructure, ML Engineering, and Product teams to architect and deliver robust systems that balance scalability, high performance, and rapid iteration.

Contribute to the teams engineering strategy, identifying gaps, proposing new initiatives, and improving existing frameworks.

Build and maintain scalable APIs and backend services for high?throughput content processing.

Leverage AWS services (ECS, Lambda, SQS, ElastiCache, CloudWatch) to design and deploy resilient, high?performance systems.

Optimize and refactor existing backend systems for scalability, reliability, and performance.

Ensure system health and data integrity through monitoring, observability, and automated testing.

Requirements

7+ years of professional software engineering experience with a focus on backend or distributed systems development.

Strong proficiency in Python (5+ years). Experience with Scala is a plus.

Expertise in designing and architecting large?scale event?driven and distributed systems.

Strong cloud expertise with AWS services (ECS, Lambda, SQS, SNS, CloudWatch, etc.).

Experience with infrastructure?as?code tools like Terraform.

Solid understanding of system performance, profiling, and optimization.

Experience leading technical projects and mentoring engineers.

Bachelors degree in Computer Science or equivalent professional experience.

Bonus: Familiarity with data processing frameworks (Spark, Databricks) and workflow orchestration tools.

Bonus: Experience integrating ML or LLM?based models into production systems.

Compensation & Benefits

In the United States, the reasonably expected salary range is between $120,000 and $217,000 for this role, varying by location. In California, the range is between $146,500 and $228,000. In Canada, the range is between $153,000 CAD and $202,000 CAD. This position is also eligible for competitive equity ownership and a comprehensive benefits package.

Benefits, Perks, And Wellbeing At Scribd

Benefits/perks listed may vary depending on the nature of your employment with Scribd and the geographical location where you work.

Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees

12 weeks paid parental leave

Short-term/long-term disability plans

401k/RSP matching

Onboarding stipend for home office peripherals + accessories

Learning & Development allowance

Learning & Development programs

Quarterly stipend for Wellness, WiFi, etc.

Mental Health support & resources

Free subscription to the Scribd Inc. suite of products

Referral Bonuses

Book Benefit

Sabbaticals

Company-wide events

Team engagement budgets

Vacation & Personal Days

Paid Holidays (+ winter break)

Flexible Sick Time

Volunteer Day

Company-wide Employee Resource Groups and programs that foster an inclusive and diverse workplace.

Access to AI Tools: We provide free access to best?in?class AI tools, empowering you to boost productivity, streamline workflows, and accelerate bold innovation.

Equal Employment Opportunity

We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing about the need for adjustments at any point in the interview process.

Scribd is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful. #J-18808-Ljbffr