Sr./Staff TPM - Inference Capacity - Sunnyvale, CA, United States
Originally posted 29 June 2026 by the employer.
Lead capacity planning and fleet strategy for the Inference Service organization.
About the role
This role involves leading capacity planning and fleet strategy for the Inference Service organization, ensuring intelligent capacity management as demand for AI continues to increase.
What you'll do
- Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster.
- Drive engineering efforts and related automation to ensure on-time and quality delivery for new datacenter capacity bring-up.
- Run the weekly capacity review across different customers/models/clusters and decide model placement and re-balancing.
- Drive stakeholder adoption of the inhouse built capacity planning and allocation tool.
- Proactively identify and mitigate capacity bottlenecks, risks, and dependencies.
- Run weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team.
What you'll need
- 5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planning.
- Experience leading large cross-functional programs involving Engineering, Product, and Operations.
- Comfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator scheduling.
- Strong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers.
- Track record of running a recurring cross-functional ritual involving senior engineers and LT.
- Direct experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, Trainium.
Skills: capacity planning, fleet strategy, datacenter bring-up, ML serving, hyperscaler
This role has been open 84 days — well above the 67-day median for Technical Program Management roles.
Technical Program Management · AI ML Hardware
|
Open roles in category
63
|
Median days open
67 d
|
Median salary
$245k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Cerebras | All employers we track in this specialty (63 roles · 19 employers) |
|---|---|---|
| Open roles in this specialty | 2 | 63 |
| Median days open | 58 d | 67 d (−9 d vs this employer) |
| Median salary (USD postings) | — | $245k |
Skills observed across this category: capacity planning, fleet strategy, datacenter bring-up, ML serving, hyperscaler
Who's hiring in this category
- NVIDIA · 14 open roles · median 82 d
- Micron Technology · 11 open roles · median 18 d
- Qualcomm · 7 open roles · median 73 d
- AMD · 6 open roles · median 46 d
- Tenstorrent · 4 open roles · median 68 d
- Lam Research · 3 open roles · median 67 d
How we counted: 63 open Technical Program Management (AI ML Hardware) roles from 19 employers tracked in the SemiconductorJobs index, counted 19 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there. Figures refresh nightly.