Software Engineer, Ingestion Platform

About the Role

The Data Platform team at Reddit is looking for a Software Engineer to solve large scale data platform and efficiency challenges. The Ingestion Platform team empowers the business to efficiently process data and orchestrate workloads, supporting Reddit's community of users generating over 100B events daily ingested into a warehouse handling 55,000+ daily queries.

Responsibilities

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, focusing on availability, scalability, latency, correctness, and cost efficiency.
• Contribute to the architecture and evolution of the platform's control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
• Expand the platform beyond Kafka-to-BigQuery by delivering production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and reusable capabilities.
• Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores.
• Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
• Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform in partnership with teams like Ads Data Platform and ML Indexing.
• Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
• Identify architecture and product experience gaps to lead redesigns that improve developer velocity.
• Collaborate across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.

Qualifications

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code.
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showing proactive leadership.
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink, and/or modern cloud-based infrastructure.
• Excellent communication skills tailored for effective collaboration within a service-oriented team and broader organizational context.

Interview Process Note

In select roles and locations, interviews may be recorded, transcribed, and summarized by artificial intelligence (AI), with the opportunity to opt out prior to scheduled interviews.