Senior System Software Engineer - Dynamo-Triton Inference Server
$224,000 - $356,500 USD yearly
Originally posted 18 September 2026 by the employer — open 1 day.
Work on Dynamo-Triton Inference Server to establish a unified, high-performance inference platform.
About the role
You will drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to create a unified platform for Large Language Model (LLM) and non-LLM workloads.
What you'll do
- Contribute to feature development and drive broad customer adoption.
- Drive convergence of Triton Inference Server and NVIDIA Dynamo stacks.
- Establish a unified, high-performance inference platform.
- Optimize and balance prediction throughput and latency.
- Be an active member of the open source deep learning software engineering community.
What you'll need
- MS or PhD in Computer Science or relevant field (or equivalent experience).
- 12+ years of professional experience working on deep learning software.
- Excellent Rust & C++ skills.
- Familiarity with Python.
- Strong programming & software design skills including debugging, performance analysis, and test design.
- Experience with high-scale distributed systems and ML systems.
Skills: GPU-accelerated, deep learning, AI inference, Triton Inference Server, LLM, distributed systems
This role has been open 0 days — well below the 44-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
861
|
Median days open
44 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (861 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 252 | 861 |
| Open roles in the wider Software, Firmware & Systems family | 943 | 5796 · 143 employers |
| Median days open | 37 d | 44 d (−7 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: GPU-accelerated, deep learning, AI inference, Triton Inference Server, LLM, distributed systems
Who's hiring in this category
- NVIDIA (this employer) · 252 open roles · median 37 d
- Qualcomm · 58 open roles · median 72 d
- AMD · 39 open roles · median 24 d
- Cerebras · 38 open roles · median 54 d
- Graphcore · 36 open roles · median 84 d
- Renesas Electronics · 33 open roles · median 26 d
How we counted: 861 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 19 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.