Senior Software Engineer, Developer Tools

About the Team

The App Test team builds the test automation platform that enables Roblox engineers to deliver reliable, high-quality experiences across the Roblox Universal App. Our systems span test frameworks, execution and orchestration, device-farm infrastructure, debugging tools, dashboards, and the supporting infra that power end-to-end testing across mobile, desktop, console, and VR.

The Role

As a Senior Software Engineer on the App Test team, you will design, build, and scale tools and services that power the test automation lifecycle. You will work on foundational systems that enable engineers to author, select, execute, debug, maintain, and triage tests efficiently, while helping evolve our platform toward an AI-native testing experience.

You will solve complex engineering problems across distributed systems, cross-platform automation, developer tooling, and AI orchestration to help teams identify regressions earlier, improve release confidence, and deliver software faster.

Responsibilities

• Build and scale test automation infrastructure: Design, implement, and evolve frameworks, runners, orchestration services, device-farm integrations, and supporting infrastructure across supported platforms.
• Advance the AI-native test lifecycle: Develop intelligent tooling that improves test authoring, selection, execution, maintenance, and failure triage using AI.
• Develop test orchestration and intelligence: Build systems connecting test planning, selection, execution, and failure analysis for efficient infrastructure use and rapid feedback.
• Improve test reliability and debugging: Build tools and services that improve test stability, observability, failure diagnosis, and maintenance.
• Shift quality earlier: Integrate automated quality checks and actionable test feedback into development and CI/CD workflows.
• Drive projects end to end: Take ownership of technical initiatives from definition and design through production deployment, adoption, and continuous improvement.
• Collaborate across engineering: Partner with application, platform, QA, infrastructure, and developer productivity teams.

Qualifications

Required

• Software engineering experience: Experience designing, building, testing, and operating production software in large codebases.
• Programming fundamentals: Strong programming skills in C++, Python, Go, or another modern programming language, writing maintainable and well-tested code.
• Automation and infrastructure: Experience building test automation frameworks, developer tools, distributed systems, CI/CD infrastructure, or engineering platforms.
• Systems and architecture: Experience designing and evolving services or frameworks with an understanding of scalability, reliability, observability, and operational excellence.
• Cross-platform engineering: Experience developing or supporting systems across multiple environments (e.g., Windows, macOS, Linux, Android, or iOS).
• Ownership and collaboration: Proven ability to take ownership of projects, work across teams, and communicate technical decisions clearly.

Nice to Have

• Experience with cross-platform test automation frameworks such as Appium, Selenium, or comparable tools (mobile, desktop, or game testing).
• Experience building CI/CD, release engineering, developer productivity, or internal platform systems.
• Experience applying LLMs, agents, or other AI techniques to developer tools (test authoring, test selection, maintenance, failure analysis, or automated debugging).
• Experience with large-scale software development workflows and integrating automated quality checks into the development lifecycle.