Software Engineer, Frontier AI Infrastructure

About the Role

Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling state of the art models, debugging the latest AI tools, managing networking, debugging latency, and tracking pricing/usage metrics for AI models. You will lead technical discussions on the frontlines with cloud vendors and customers to deliver on critical contracts and to debug platform issues. You will also work upstream with Product to understand features before they break, moving us from "infra-only debugging" to proactive integration testing.

Responsibilities

• Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure.
• Own services or systems and define their long-term health goals, while also improving the health of surrounding components.
• Re-architect the stack to run in compliant or restrictive environments. This requires designing swappable components (auth, storage, logging) to meet government/security mandates without breaking the product.
• Work with Product to build integration tests that catch issues early, shifting the focus from "infra-only debugging" to preventing failures upstream.
• Participate actively in customer engagements, working closely with stakeholders to understand requirements and deliver innovative solutions.
• Contribute to the platform roadmap and product strategy for Scale AI's Public Sector business, playing a key role in shaping the future direction of our offerings.

Requirements

• Security Clearance: At least an active secret clearance and the ability & willingness to up level to TS/SCI with CI Poly. (Candidates will not be considered who do not hold at least a secret clearance).
• Ability to support work 3-4 days a week from the DC, SF, NYC, or STL office.

Preferred Qualifications

• Full Stack Development: Proficiency in both front-end and back-end development, including experience with modern web development frameworks, programming languages, and databases. Experience with developing & delivering software to air-gapped & isolated environments is a plus.
• Cloud-Native Technologies: Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes). Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience developing and deploying applications in a cloud-native environment.
• Security Focused: Experience with Federal Compliance frameworks and requirements (e.g., Cloud SRG, FedRAMP, STIG Benchmarks, etc.). Experience developing software & technical solutions that meet strict security & regulatory compliance requirements.
• Problem Solving: Strong analytical and problem-solving skills to understand complex challenges and devise effective solutions.
• Collaboration and Communication: Excellent interpersonal and communication skills to collaborate with cross-functional teams, stakeholders, and customers.
• Adaptability and Learning Agility: Willingness to embrace new technologies, learn new skills, and adapt to evolving project requirements.

Note

Our policy requires a 90-day waiting period before reconsidering candidates for the same role.