Senior Product Manager, Switchyard - United States
$168,000 - $327,750 USD yearly
Originally posted 2 October 2026 by the employer.
Lead product strategy for Switchyard, NVIDIA's adaptive inference runtime.
About the role
This role involves leading product management for Switchyard, an adaptive inference runtime for systems of models.
What you'll do
- Drive Switchyard’s product strategy and roadmap, setting priorities and product outcomes.
- Work with partners to make integrations successful and incorporate market feedback into product capabilities.
- Define the developer experience and product interfaces for adaptive inference.
- Translate research advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features.
- Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and customization paths.
- Build adoption motions, identify qualified workloads, guide partner pilots, and create repeatable deployment playbooks.
- Establish messaging and narrative for model routing and adaptive inference.
- Define and inspect evidence for success, owning the outcomes.
What you'll need
- Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or equivalent experience.
- 8+ years of product management or related experience building technical products for developers, infrastructure teams, or AI practitioners.
- Record of scaling developer or infrastructure products through partnership and integrations.
- Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs.
- Ability to engage mature customers and partners independently to uncover production constraints.
- Positive relationships with Engineering and Research teams, converting uncertainty into decisions.
- Evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
- Excellent written and verbal communication, good judgment, and ability to align senior technical and business leaders.
- Technical depth to inspect APIs, traces, and benchmark results directly.
Skills: Product Manager, product strategy and roadmap, model routing, adaptive inference, LLM inference, developer experience
This role has been open 1 day — well below the 39-day median for Product Management roles.
Product Management · AI ML Hardware
|
Open roles in category
68
|
Median days open
39 d
|
Median salary
$248k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (68 roles · 21 employers) |
|---|---|---|
| Open roles in this specialty | 19 | 68 |
| Median days open | 39 d | 39 d (same as this employer) |
| Median salary (USD postings) | — | $248k |
Skills observed across this category: Product Manager, product strategy and roadmap, model routing, adaptive inference, LLM inference, developer experience
Who's hiring in this category
- NVIDIA (this employer) · 19 open roles · median 39 d
- Qualcomm · 10 open roles · median 52 d
- AMD · 9 open roles · median 37 d
- Micron Technology · 5 open roles · median 51 d
- Analog Devices · 3 open roles · median 22 d
- NXP Semiconductors · 3 open roles · median 4 d
How we counted: 68 open Product Management (AI ML Hardware) roles from 21 employers tracked in the SemiconductorJobs index, counted 4 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there. Figures refresh nightly.