Skip to main content
NVIDIA

Deep Learning Framework Communications Engineer - New College Grad 2026

NVIDIA Santa Clara, CA, United States Full-time 4 days ago
Embedded & Systems Software

$124,000 - $241,500 USD yearly

Bring communication technologies like NCCL, NVSHMEM, and GPUDirect into AI stacks such as PyTorch, JAX, and vLLM.

Originally posted November 14, 2026 by the employer.

About the role

This role integrates communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will work with the team that created communication libraries like NCCL and NVSHMEM and technologies like GPUDirect for scaling Deep Learning and HPC applications across multi-GPU setups.

What you'll do

  • Integrate new communication library features into AI frameworks, progressing from proof-of-concept to performance analysis to production.
  • Perform deep analysis of AI workloads and frameworks to identify multi-GPU communication requirements and opportunities.
  • Improve AI compilers to hide communications or execute automatic fusion.
  • Conduct in-depth AI workload performance characterization on multi-GPU clusters.
  • Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads.
  • Author custom communication or fused compute-communication kernels, and influence the roadmap of NCCL and NVSHMEM.

What you'll need

  • B.S, M.S. or PHD in Computer Science, or related field (or equivalent experience) with software engineering and HPC/AI experience.
  • Development or integration experience with Deep Learning Frameworks such as PyTorch, JAX, and Inference Engines such as TRT-LLM, vLLM, SGLang.
  • Rapid prototyping and development experience with Python, C++, CUDA or related DSLs (Triton, cuTe).
  • Solid grasp of AI models, parallelisms, and/or compiler technologies (e.g. torch.compile).
  • Experience conducting performance benchmarking on AI clusters, with familiarity in at least one performance profiler toolchain (PyTorch profiler, NVIDIA Nsight Systems).
  • Understanding of HPC/AI communication concepts (1-sided vs 2-sided communication, elasticity, resiliency, topology discovery, etc).

Skills: NCCL, NVSHMEM, PyTorch, CUDA, Multi-GPU, Deep Learning

More semiconductor jobs: NVIDIA jobs · California jobs

Market context

First seen in our index 0 days ago, well below the 58-day median for Infrastructure/Platform Software roles.

Infrastructure/Platform Software · Infrastructure Platform

Open roles in category
1057
Median days since first seen
58 d
Category median salary (all employers)
$236k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How NVIDIA compares in Infrastructure/Platform Software hiring
Metric NVIDIA All employers we track in this specialty (1057 roles · 98 employers)
Open roles in this specialty 359 1057
Open roles in the wider Software, Firmware & Systems family 1290 6830 · 181 employers
Median days since first seen 60 d 58 d (−2 d vs this employer)
Median salary (USD postings) n/a $236k

Skills observed across this category: NCCL, NVSHMEM, PyTorch, CUDA, Multi-GPU, Deep Learning

Who's hiring in this category

  • NVIDIA (this employer) · 358 open roles · median 60 d
  • Qualcomm · 69 open roles · median 59 d
  • AMD · 55 open roles · median 39 d
  • Graphcore · 47 open roles · median 121 d
  • Arm Holdings · 38 open roles · median 18 d
  • Cerebras · 36 open roles · median 110 d

How we counted: 1057 open Infrastructure/Platform Software (Infrastructure Platform) roles from 98 employers tracked in the SemiconductorJobs index, counted 15 Nov 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there, and is counted in the wider Software, Firmware & Systems family row. Days are counted from when our index first saw each posting, not from the employer's original posting date.

Apply now
Santa Clara, CA, United States
On-site
Full-time
$124,000 - $241,500 USD yearly
4 days ago

Share this job