Product Manager, Compute Platform
Apply at source. Anthropic handles the application directly; Houtini doesn't take a fee from candidates or companies. We curate which companies appear; the listings come from yubhub.
What the team is looking for.
As a Product Manager focused on Compute Platform, you'll partner with Infrastructure, Compute Operations, Engineering, Finance & Strategy, and Research to build the scheduling, orchestration, and capacity management systems that power Anthropic's compute infrastructure.
- Partner with Infrastructure to build the systems that determine how jobs are scheduled, prioritized, and allocated across Anthropic's growing fleet of GPU and accelerator clusters,ensuring the right workloads run on the right hardware at the right time.
- Your work directly impacts cluster utilization, cost efficiency, and researcher velocity: defining the semantic layer for job scheduling, establishing resource guarantees, and making the trade-offs that keep our infrastructure running at peak capacity.
- You'll drive the evolution of our compute platform to support increasingly diverse workloads,from large-scale training runs and fine-tuning jobs to real-time inference and batch evaluation,each with distinct scheduling requirements, priority levels, and resource profiles.
Responsibilities:
- Deeply understand the needs of internal customers across Research, Infrastructure, Product, and Finance,from researchers who need guaranteed resources for multi-week training runs to platform teams managing inference workloads with strict latency SLAs.
- Define and iterate on the semantic layer for job scheduling: the abstractions, priority tiers, resource classes, and preemption policies that govern how work flows through our compute clusters.
- Partnering with engineering leads to design scheduling capabilities that maximize cluster utilization while honoring resource guarantees,ensuring jobs have the right prerequisites (data, checkpoints, hardware affinity) validated before launch to avoid wasted compute.
- Drive product strategy and roadmap for compute capacity management, including quota systems, fairness policies, bin-packing optimizations, and gang-scheduling for distributed workloads.
- Own the trade-off framework between utilization efficiency, job latency, cost, and reliability,making transparent prioritization decisions and communicating them clearly to senior leadership.
- Collaborate with the Capacity Strategy & Operations team on capacity planning models, demand forecasting, and cost-to-serve analytics that inform infrastructure investment decisions.
- Build and champion observability tools and dashboards that provide real-time visibility into cluster health, queue depth, scheduling efficiency, and resource waste.
You may be a good fit if you have:
- 7+ years of product management experience, with deep exposure to compute infrastructure, distributed systems, or scheduling/orchestration platforms
- Experience taking technical infrastructure products from infancy to scale,you’ve built something from the ground up and grown it to serve demanding internal or external customers
- Track record of building platform products that balance the needs of multiple users and stakeholders,you’re comfortable making prioritization trade-offs between utilization, latency, cost, and fairness, and communicating them clearly
- Ability to internalize complex technical systems (job schedulers, cluster managers, resource orchestrators) and translate that understanding into a comprehensive product vision
- Fluent across functions,you’re equally credible discussing scheduling algorithms with engineers, capacity economics with finance, and infrastructure strategy with leadership
- Strong instinct for connecting technical decisions to business outcomes: every percentage point of cluster utilization has measurable impact
- Scrappy and resourceful,you do what it takes to get things done in a fast-moving environment
Strong candidates may have:
- Built or scaled job scheduling, resource orchestration, or workload management systems for large-scale compute clusters (e.g., Kubernetes, Slurm, Borg, YARN, or custom schedulers).
- Deep familiarity with GPU/accelerator scheduling challenges, including gang-scheduling, topology-aware placement, preemption, and hardware affinity constraints.
- Experience defining and enforcing SLAs and resource guarantees for compute workloads,including mechanisms to validate job prerequisites (data readiness, checkpoint availability, hardware compatibility) before scheduling to avoid wasted resources.
- Capacity planning experience across cloud and on-premises infrastructure, including cost modeling, demand forecasting, and vendor management for compute procurement.
- Scaled through hypergrowth in compute-intensive environments (AI/ML, HPC, large-scale cloud infrastructure).
- Experience with observability and efficiency tooling for distributed infrastructure,building dashboards, automation, and governance workflows that drive utilization and cost accountability.
- product management
- compute infrastructure
- distributed systems
- scheduling/orchestration platforms
- job schedulers
- cluster managers
- resource orchestrators
- GPU/accelerator scheduling
- gang-scheduling
- topology-aware placement
- preemption
- hardware affinity constraints
- capacity planning
- cost modeling
- demand forecasting
- vendor management
Other roles you might consider.
Filtered through the same AI-companies allowlist.
Field Engineer
Anysphere
Technical Support Engineer
Anysphere
Forward Deployed Engineering Recruiter
ElevenLabs
Member of Technical Staff (AI Software Engineer, Multimodal)
Perplexity
Forward Deployed Engineering Recruiter
ElevenLabs
Member of Technical Staff (AI Software Engineer, Agents)
Perplexity
New to AI work? Start with these.
Six pieces of orientation. Most AI-company job specs assume you've done this kind of hands-on work already. If you haven't, an afternoon with one of these is the cheapest way to close the gap.
Claude Desktop, from zero.
The agentic-AI assistant most of the people you'd be working alongside use every day. Install, configure, first useful prompts.
What MCPs areThe best MCPs for Claude Desktop.
MCP servers extend an AI assistant with tools and data. The catalogue most teams use. Useful technical context for any AI-engineering role.
Code with AIClaude Code, the complete beginners' guide.
The CLI for AI-paired development. Required reading if you're applying for any engineering role that mentions agents, or any role full stop.
Run a local modelHow to set up LM Studio.
Running a model on your own machine teaches you more about how AI products work in three hours than a year of using ChatGPT will.
The hardware realityBeginner's guide to AI hardware.
What the infrastructure under the model actually looks like. Useful context for infrastructure, applied-AI and hardware roles.
Browse the stackMCP catalogue.
Eleven MCP servers Houtini maintains or recommends. Each detail page describes a real piece of working AI infrastructure.