Software Engineer, Ingestion Platform

Reddit is a community-driven platform whose Data Platform team supports large-scale data, machine learning, and business intelligence workloads. The Software Engineer will build and improve scalable, fault-tolerant ingestion systems for distributed streaming and batch data movement, while collaborating with infrastructure, product, and partner teams.

Tags

Social Media

Consumer Goods

Digital Media

Marketing

Telecom & Communications

Apps

Publishing

Communities

Consumer

Consumer Applications

Content

Digital Marketing

Responsibilities

Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency

Contribute to the architecture and evolution of the platform’s control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations

Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities

Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend

Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting

Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch

Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response

Identify gaps in the platform’s architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit’s continued growth

Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions

Benefits

Comprehensive Healthcare Benefits and Income Replacement Programs

401k with Employer Match

Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support

Family Planning Support

Gender-Affirming Care

Mental Health & Coaching Benefits

Flexible Vacation & Paid Volunteer Time Off

Generous Paid Parental Leave

Equity in the form of restricted stock units

Depending on the position offered, eligibility to receive a commission

Medical, dental, and vision insurance

401(k) program with employer match

Generous time off for vacation and parental leave

Glassdoor

3.9

Reddit is the heart of the internet, where millions of people get together to talk about any topic imaginable.

San Francisco, California, USA

https://www.redditinc.com

Distribution of Different Job Fields Receiving Sponsorship

84

Represents job field similar to this job

Engineering and Development

Product Management

Management and Executive

Creatives and Design

Sales

Accounting and Finance

Customer Service and Support

Trends of Total Sponsorships

*2026

Qualifications

2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code

Proficient in object-oriented programming languages like Python, Scala, Go, or Java

Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects

Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure

Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context

Required skills

Object-Oriented Programming, Distributed Systems, Cloud Services, Airflow, Kubernetes, CI/CD, Apache Spark, Apache Flink, Python, Scala, Go, Java

Experience

2+ years