Senior Product Manager - AI Platform Inference - CA, Santa Clara, United States
$168,000 - $327,750 USD yearly
Originally posted 5 August 2026 by the employer.
You will be responsible for building tools, SDKs, and libraries that enable Inference deployments to thrive on NVIDIA GPUs.
About the role
This role focuses on building tools, SDKs, and libraries to enable developers' Inference deployments on NVIDIA GPUs. Inference is a rapidly evolving area in Generative AI, with new acceleration algorithms, use cases, and deployment techniques.
What you'll do
- Create products to help developers build better Inference deployments
- Develop product strategy, roadmaps, and go-to-market plans
- Collaborate with internal and external developers to build product-based roadmaps for model optimization software
- Work with leadership to align with and drive company strategy
What you'll need
- Experience with Inference deployment and optimization software (ex. vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.)
- Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, and software development and delivery
- BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience)
- 6+ years of technical product management, or similar, experience at a technology company
- Strong communication and interpersonal skills
Skills: product strategy, roadmaps, go-to-market plans, Inference deployment, model optimization software
This role has been open 71 days — well above the 44-day median for Product Management roles.
Product Management · AI ML Hardware
|
Open roles in category
70
|
Median days open
44 d
|
Median salary
$248k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (70 roles · 22 employers) |
|---|---|---|
| Open roles in this specialty | 22 | 70 |
| Median days open | 32 d | 44 d (−12 d vs this employer) |
| Median salary (USD postings) | — | $248k |
Skills observed across this category: product strategy, roadmaps, go-to-market plans, Inference deployment, model optimization software
Who's hiring in this category
- NVIDIA (this employer) · 22 open roles · median 32 d
- Qualcomm · 10 open roles · median 66 d
- AMD · 8 open roles · median 51 d
- NXP Semiconductors · 4 open roles · median 17 d
- Analog Devices · 3 open roles · median 36 d
- SambaNova · 3 open roles · median 38 d
How we counted: 70 open Product Management (AI ML Hardware) roles from 22 employers tracked in the SemiconductorJobs index, counted 18 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there. Figures refresh nightly.