Staff Software Engineer, Data Warehouse

About the Role

The Data Warehouse Infrastructure team is responsible for the foundational big data infrastructure used by hundreds of engineers to collect, manage, and analyze data at scale. The team leverages open source technologies including Hadoop, Spark, Trino, Iceberg, and Airflow.

Responsibilities

• Design and build the next generation big data compute platform to empower data ETL, analytics, and machine learning at Airbnb.
• Operate, manage, and improve the reliability, performance, observability, and cost efficiency of the platform.
• Write maintainable and self-documenting code; perform code reviews.
• Work on and contribute to open source software, driving industry impact.

Qualifications

Required

• 10+ years of experience working with data infrastructure, with a focus on big data technologies.
• Proficiency in big data technologies such as Spark, Presto/Trino, and Kubernetes.
• Strong programming skills in languages such as Java or Scala.
• Extensive experience designing, building, and maintaining scalable, fault-tolerant distributed systems.
• Demonstrated expertise in multi-threading and concurrency programming.
• Familiarity with database systems, both SQL and NoSQL.
• Proven ability to collaborate with other teams to define system requirements, identify potential solutions, and test and integrate systems.
• Capacity to troubleshoot and resolve complex data infrastructure problems.
• Strong communication skills, both written and verbal, and ability to work effectively in a team environment.

Preferred

• BS/MS/PhD in Computer Science, a related field, or equivalent work experience.