Senior AI-Native Systems Software Engineer, TensorRT - CA, Santa Clara, United States
Originally posted 5 August 2026 by the employer. Relisted by the employer on 27 October 2026.
About the role
NVIDIA's TensorRT team is seeking a Senior AI-Native Systems Software Engineer to build an agentic development framework for high-performance inference software. The role centers on using multi-agent AI orchestration to scale the generation, testing, and optimization of modern C++ runtime code.
What you'll do
- Architect an AI-native framework and codebase designed for AI agents working in parallel to generate, test, and validate production-grade software. - Build multi-agent orchestrators, AI-native tools, and codebase harnesses to scale software development workflows. - Prototype and integrate deep learning breakthroughs, such as novel attention mechanisms and KV cache strategies, using AI agent swarms. - Provide a path to production for modern model families including LLMs, Diffusion, Audio, Vision, and multi-modal models. - Optimize software at the intersection of Python orchestration and C++ engine levels to improve latency and throughput.
What you'll need
- BS, MS, or PhD in Computer Science, Computer Engineering, AI, or equivalent experience. - 4+ years of relevant software development experience. - Proficiency with modern C++ (C++11/14/17 or newer) and the STL for performant and maintainable code. - Experience with modern inference frameworks and architectural knowledge of LLMs, Diffusion, and multi-modal models. - Systems-thinking background focused on scaling automated, agent-driven software development architectures.
Skills: Generative AI, TensorRT, AI-native framework, C++, deep learning optimization
This role has been open 189 days — well above the 55-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1016
|
Median days open
55 d
|
Median salary
$223k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (1016 roles · 91 employers) |
|---|---|---|
| Open roles in this specialty | 286 | 1016 |
| Open roles in the wider Software, Firmware & Systems family | 993 | 6292 · 146 employers |
| Median days open | 51 d | 55 d (−4 d vs this employer) |
| Median salary (USD postings) | — | $223k |
Skills observed across this category: Generative AI, TensorRT, AI-native framework, C++, deep learning optimization
Who's hiring in this category
- NVIDIA (this employer) · 286 open roles · median 52 d
- Qualcomm · 62 open roles · median 58 d
- AMD · 56 open roles · median 31 d
- Intel Corporation · 49 open roles · median 13 d
- Graphcore · 48 open roles · median 103 d
- Cerebras · 35 open roles · median 92 d
How we counted: 1016 open Infrastructure/Platform Software (Infrastructure Platform) roles from 91 employers tracked in the SemiconductorJobs index, counted 28 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.