Senior Software Engineer, SRE and Production Engineering - DGX Cloud - United States
$152,000 - $287,500 USD yearly
Originally posted 29 September 2026 by the employer.
This role focuses on large-scale GPU infrastructure for AI workloads.
About the role
This role involves building and operating large-scale GPU infrastructure for AI workloads. You will build software and operational tooling for an IaaS production environment of BMaaS and VMaaS.
What you'll do
- Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management.
- Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows.
- Handle NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments.
- Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes.
- Define validation and handoff criteria for new capacity to enter production safely and consistently.
- Participate in on-call duties, incident response, root-cause analysis, and implement permanent solutions.
What you'll need
- 5+ years building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
- Strong Go or Python skills, with a record of delivering production automation and services.
- Direct experience with BMC and Redfish in server provisioning, health inspection, power management, or fault diagnosis.
- Practical experience working directly with NVIDIA GPU hardware, such as NVL72 systems, and BlueField-3 or newer DPUs.
- Experience with Linux, firmware and driver management, network boot, and the server lifecycle.
- Experience managing production reliability through on-call duties, incident response, and observability.
- Ability to debug failures across hardware, host operating systems, networking, and distributed services.
Skills: GPU infrastructure, bare-metal provisioning, hardware validation, BMC and Redfish, NVIDIA NVL72 systems
This role has been open 16 days — well below the 51-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
974
|
Median days open
51 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (974 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 281 | 974 |
| Open roles in the wider Software, Firmware & Systems family | 991 | 6156 · 145 employers |
| Median days open | 45 d | 51 d (−6 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: GPU infrastructure, bare-metal provisioning, hardware validation, BMC and Redfish, NVIDIA NVL72 systems
Who's hiring in this category
- NVIDIA (this employer) · 281 open roles · median 46 d
- Qualcomm · 61 open roles · median 55 d
- AMD · 55 open roles · median 22 d
- Graphcore · 44 open roles · median 91 d
- Intel Corporation · 41 open roles · median 10 d
- Cerebras · 39 open roles · median 81 d
How we counted: 974 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 16 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.