Principal Product Manager - San Jose, California, United States
$190,000 - $230,000 USD yearly
Originally posted 15 October 2026 by the employer.
Own the model and capability roadmap for SambaNova's full-stack inference platform.
About the role
This role involves owning SambaNova's model and capability roadmap end to end, focusing on its full-stack inference platform built around the RDU chip.
What you'll do
- Own and drive the unified, weighted stack rank of candidate models based on customer demand, capability, market adoption, strategic value, and engineering effort.
- Define and manage the per-chip roadmap for models across hardware generation, configuration, and performance targets.
- Translate priorities into dated commitments with engineering, track delivery, and execute model launches.
- Set the definition of a “fully featured” model across speed, efficiency, model infrastructure, cloud, and API features.
- Test and evaluate new models, identifying where they excel and where gaps exist.
- Build quick prototypes and mock-ups to demonstrate the value of a model.
What you'll need
- Bachelor's degree or higher in Computer Science, Engineering, Machine Learning, or a related technical field.
- 7+ years of combined experience in product management and technical roles, including 3+ years as a PM on AI/ML, developer, or infrastructure products.
- Strong working knowledge of LLMs: transformer and MoE architectures, inference trade-offs (latency, throughput, context, quantization), and features such as function calling, structured output, and reasoning.
- Proven track record of owning a roadmap and shipping products, setting priorities under constraints, and driving cross-functional teams.
- Comfort with data, including building and maintaining prioritization models, dashboards, and scorecards.
- Hands-on experience with models: calling model APIs, running evals and quick experiments, and building simple prototypes or mock-ups (Python, notebooks, or lightweight UI tools).
- Excellent written and verbal communication skills, with the ability to present a roadmap and defend trade-offs.
Nice to have
- Product experience at an inference provider, model lab, AI cloud, or AI hardware company.
- Hands-on familiarity with inference stacks (vLLM, SGLang, TensorRT-LLM) and OpenAI/Anthropic-compatible APIs.
- Experience designing evals and benchmark methodology for model quality and feature conformance.
- A background as an ML or solutions engineer before moving into product.
- Experience with enterprise, sovereign AI, or public-sector customers.
- An active presence in the open-source model community.
Skills: roadmap, prioritization, LLMs, inference trade-offs, market intelligence
This role has been open 0 days — well below the 44-day median for Product Management roles.
Product Management · AI ML Hardware
|
Open roles in category
67
|
Median days open
44 d
|
Median salary
$248k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | SambaNova | All employers we track in this specialty (67 roles · 21 employers) |
|---|---|---|
| Open roles in this specialty | 3 | 67 |
| Median days open | 36 d | 44 d (−8 d vs this employer) |
| Median salary (USD postings) | — | $248k |
Skills observed across this category: roadmap, prioritization, LLMs, inference trade-offs, market intelligence
Who's hiring in this category
- NVIDIA · 21 open roles · median 31 d
- Qualcomm · 10 open roles · median 64 d
- AMD · 8 open roles · median 49 d
- NXP Semiconductors · 4 open roles · median 15 d
- Analog Devices · 3 open roles · median 34 d
- Intel Corporation · 2 open roles · median 34 d
How we counted: 67 open Product Management (AI ML Hardware) roles from 21 employers tracked in the SemiconductorJobs index, counted 16 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there. Figures refresh nightly.