$124,000 - $241,500 USD yearly
Bring communication technologies like NCCL, NVSHMEM, and GPUDirect into AI stacks such as PyTorch, JAX, and vLLM.
Originally posted November 14, 2026 by the employer.
About the role
This role integrates communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will work with the team that created communication libraries like NCCL and NVSHMEM and technologies like GPUDirect for scaling Deep Learning and HPC applications across multi-GPU setups.
What you'll do
- Integrate new communication library features into AI frameworks, progressing from proof-of-concept to performance analysis to production.
- Perform deep analysis of AI workloads and frameworks to identify multi-GPU communication requirements and opportunities.
- Improve AI compilers to hide communications or execute automatic fusion.
- Conduct in-depth AI workload performance characterization on multi-GPU clusters.
- Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads.
- Author custom communication or fused compute-communication kernels, and influence the roadmap of NCCL and NVSHMEM.
What you'll need
- B.S, M.S. or PHD in Computer Science, or related field (or equivalent experience) with software engineering and HPC/AI experience.
- Development or integration experience with Deep Learning Frameworks such as PyTorch, JAX, and Inference Engines such as TRT-LLM, vLLM, SGLang.
- Rapid prototyping and development experience with Python, C++, CUDA or related DSLs (Triton, cuTe).
- Solid grasp of AI models, parallelisms, and/or compiler technologies (e.g. torch.compile).
- Experience conducting performance benchmarking on AI clusters, with familiarity in at least one performance profiler toolchain (PyTorch profiler, NVIDIA Nsight Systems).
- Understanding of HPC/AI communication concepts (1-sided vs 2-sided communication, elasticity, resiliency, topology discovery, etc).
Skills: NCCL, NVSHMEM, PyTorch, CUDA, Multi-GPU, Deep Learning
More semiconductor jobs: NVIDIA jobs · California jobs
First seen in our index 0 days ago, well below the 58-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1057
|
Median days since first seen
58 d
|
Category median salary (all employers)
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (1057 roles · 98 employers) |
|---|---|---|
| Open roles in this specialty | 359 | 1057 |
| Open roles in the wider Software, Firmware & Systems family | 1290 | 6830 · 181 employers |
| Median days since first seen | 60 d | 58 d (−2 d vs this employer) |
| Median salary (USD postings) | n/a | $236k |
Skills observed across this category: NCCL, NVSHMEM, PyTorch, CUDA, Multi-GPU, Deep Learning
Who's hiring in this category
- NVIDIA (this employer) · 358 open roles · median 60 d
- Qualcomm · 69 open roles · median 59 d
- AMD · 55 open roles · median 39 d
- Graphcore · 47 open roles · median 121 d
- Arm Holdings · 38 open roles · median 18 d
- Cerebras · 36 open roles · median 110 d
How we counted: 1057 open Infrastructure/Platform Software (Infrastructure Platform) roles from 98 employers tracked in the SemiconductorJobs index, counted 15 Nov 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there, and is counted in the wider Software, Firmware & Systems family row. Days are counted from when our index first saw each posting, not from the employer's original posting date.