Skip to main content
All jobs

Employer listing

Staff Technical Program Manager, Inference

CoreWeave

Bellevue, Wa · on site · full time · Staff

$177,000 - $237,000

About the Team

The AI/ML TPM team owns delivery and execution across CoreWeave’s AI/ML Platform Services organization. The team partners closely with Product, Engineering, Research, Infrastructure, and Go-to-Market teams to deliver scalable, reliable, and high-performance platforms supporting the full AI lifecycle.

About the Role

CoreWeave’s AI/ML Platform Services organization builds distributed systems powering large-scale inference workloads across our GPU-accelerated cloud. As a Technical Program Manager focused on inference, you will lead complex, cross-functional programs spanning inference platform delivery, customer onboarding, launch readiness, and runtime optimization for serverless and dedicated inference use cases.

What You’ll Do

  • Drive end-to-end program management for inference platform initiatives spanning reliability, customer onboarding, launch readiness, and runtime optimization.
  • Lead cross-functional programs for customer onboarding across dedicated and serverless inference offerings, ensuring clear ownership, launch criteria, and readiness for strategic customer use cases.
  • Drive launch readiness for new inference capabilities by aligning teams around real customer outcomes, supportability, and end-to-end validation.
  • Partner with engineering and product to define and deliver roadmap outcomes for latency, throughput, uptime, operational quality, and price-performance.
  • Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable and scalable inference services.
  • Build and operationalize success metrics, dashboards, launch gates, and review cadences to measure service reliability, onboarding readiness, efficiency, and quality across the inference stack.
  • Establish repeatable processes for release validation, performance regression tracking, launch management, and postmortem follow-through.
  • Help unify operational processes, support mechanisms, and execution visibility across inference deployment models and customer onboarding paths.
  • Create strong communication channels between Engineering, Product, Infrastructure, and Go-to-Market teams to align priorities and deliver predictable, high-impact outcomes.

Who You Are

  • Bachelor’s degree in a technical field or equivalent practical experience.
  • 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
  • Proven experience driving large-scale infrastructure or platform programs from concept to production in complex, cross-functional environments.
  • Strong technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
  • Demonstrated success driving measurable improvements in reliability, performance, operational readiness, or customer delivery.
  • Excellent written and verbal communication skills, with the ability to align engineering, product, infrastructure, and customer-facing stakeholders around shared goals.
  • Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
  • Familiarity with launch readiness, supportability, incident follow-through, and release validation for production infrastructure or platform services.
  • Understanding of customer onboarding for technical products, especially where platform capabilities, infrastructure readiness, and support processes must align for launch.
  • Experience operating in high-growth environments where roadmap execution, reliability expectations, and customer commitments must be managed in parallel.

Export Control Compliance

This position requires access to export-controlled information. To conform to U.S. Government export regulations, applicants must be a U.S. person, eligible to access the information without export authorization, or eligible and reasonably likely to obtain the required authorization.

Benefits

CoreWeave offers 100% company-paid medical, dental, and vision insurance, 401(k) with employer match, flexible PTO, company-paid life and disability insurance, FSA/HSA, tuition reimbursement, ESPP participation, mental wellness benefits, parental leave, childcare support, and daily catered lunches.