Employer listing
Staff Technical Program Manager, Inference
CoreWeave
Bellevue, Wa · on site · full time · Staff
$177,000 - $237,000
About the Team
The AI/ML TPM team owns delivery and execution across CoreWeave’s AI/ML Platform Services organization. The team partners closely with Product, Engineering, Research, Infrastructure, and Go-to-Market teams to deliver scalable, reliable, and high-performance platforms supporting the full AI lifecycle.
About the Role
CoreWeave’s AI/ML Platform Services organization builds distributed systems powering large-scale inference workloads across our GPU-accelerated cloud. As a Technical Program Manager focused on inference, you will lead complex, cross-functional programs spanning inference platform delivery, customer onboarding, launch readiness, and runtime optimization for serverless and dedicated inference use cases.
What You’ll Do
- Drive end-to-end program management for inference platform initiatives spanning reliability, customer onboarding, launch readiness, and runtime optimization.
- Lead cross-functional programs for customer onboarding across dedicated and serverless inference offerings, ensuring clear ownership, launch criteria, and readiness for strategic customer use cases.
- Drive launch readiness for new inference capabilities by aligning teams around real customer outcomes, supportability, and end-to-end validation.
- Partner with engineering and product to define and deliver roadmap outcomes for latency, throughput, uptime, operational quality, and price-performance.
- Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable and scalable inference services.
- Build and operationalize success metrics, dashboards, launch gates, and review cadences to measure service reliability, onboarding readiness, efficiency, and quality across the inference stack.
- Establish repeatable processes for release validation, performance regression tracking, launch management, and postmortem follow-through.
- Help unify operational processes, support mechanisms, and execution visibility across inference deployment models and customer onboarding paths.
- Create strong communication channels between Engineering, Product, Infrastructure, and Go-to-Market teams to align priorities and deliver predictable, high-impact outcomes.
Who You Are
- Bachelor’s degree in a technical field or equivalent practical experience.
- 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
- Proven experience driving large-scale infrastructure or platform programs from concept to production in complex, cross-functional environments.
- Strong technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
- Demonstrated success driving measurable improvements in reliability, performance, operational readiness, or customer delivery.
- Excellent written and verbal communication skills, with the ability to align engineering, product, infrastructure, and customer-facing stakeholders around shared goals.
- Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
- Familiarity with launch readiness, supportability, incident follow-through, and release validation for production infrastructure or platform services.
- Understanding of customer onboarding for technical products, especially where platform capabilities, infrastructure readiness, and support processes must align for launch.
- Experience operating in high-growth environments where roadmap execution, reliability expectations, and customer commitments must be managed in parallel.
Export Control Compliance
This position requires access to export-controlled information. To conform to U.S. Government export regulations, applicants must be a U.S. person, eligible to access the information without export authorization, or eligible and reasonably likely to obtain the required authorization.
Benefits
CoreWeave offers 100% company-paid medical, dental, and vision insurance, 401(k) with employer match, flexible PTO, company-paid life and disability insurance, FSA/HSA, tuition reimbursement, ESPP participation, mental wellness benefits, parental leave, childcare support, and daily catered lunches.