Principal Software Engineer

About the Role

The Observability team owns the entire stack of Telemetry, Distributed Tracing, and Logs, including instrumentation libraries, data processing pipelines, data storage, and the visualization UI. We provide the vital signs for software components that subtend to our platform.

As a Principal Software Engineer in the Observability team, you will report to the Engineering Manager for Observability and architect our next-generation observability platform ingesting petabytes of log and tracing data daily.

Responsibilities

• Work with business partners to determine the vision and roadmap, and lead project execution end-to-end.
• Focus especially on novel solutions to monitor AI/ML systems, covering the full AI/ML lifecycle and ecosystem.
• Take full ownership of existing observability infrastructure systems, ensuring scalability, reliability, and usability while improving with new features and functionality.
• Architect the next-generation observability platform handling PBs of log and tracing data every day.
• Follow and expand our vision to put the Roblox community first and get things done.

Requirements

• 8+ years of working experience building, maintaining, and evolving large-scale distributed systems.
• Demonstrated understanding of all components required to build modern, large-scale infrastructures.
• Track record of ownership of end-to-end availability and performance of critical services to reduce operational overhead.
• Love of learning and drive to pick up new technologies as the landscape evolves.
• Passion for mentoring junior engineers, earning their respect, and leveling up their technical knowledge.
• BS in Computer Science or related fields.

Preferred Qualifications

• Previous contributions to the Open Source Community is a big plus.
• Master's degree or higher is a definite plus.

Work Arrangement

This is a hybrid role located at our San Mateo headquarters, requiring in-office presence 3 days a week (Tuesday through Thursday).