High-Performance LLM Training Engineer - New College Grad 2027 - CA, Santa Clara, United States
$124,000 - $241,500 USD yearly
Originally posted 21 October 2026 by the employer.
About the role
This position focuses on optimizing NVIDIA's high-performance LLM software stack in frameworks like PyTorch and JAX for pre-training and post-training on thousands of GPUs, as well as shaping hardware roadmaps.
What you'll do
- Understand, analyze, profile, and optimize AI training workloads on hardware and software platforms. - Implement production-quality software across multiple layers of NVIDIA's deep learning platform stack. - Implement key LLM training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies. - Build agentic tools to automate workload analysis, workload optimization, and critical workflows.
What you'll need
- M.S. or PhD in Computer Science, Electrical Engineering, or Computer Engineering (or equivalent experience). - Strong background in deep learning and neural networks, particularly model training optimizations. - Strong background in computer architecture and familiarity with the fundamentals of GPU architecture. - Experience analyzing and tuning application performance along with processor and system-level performance modeling. - Programming skills in C++, Python, and CUDA.
Skills: LLM training, CUDA, PyTorch, performance modeling, GPU architecture
This role has been open 0 days — well below the 56-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
238
|
Median days open
56 d
|
Median salary
$221k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (238 roles · 20 employers) |
|---|---|---|
| Open roles in this specialty | 120 | 238 |
| Open roles in the wider Software, Firmware & Systems family | 997 | 6291 · 145 employers |
| Median days open | 56 d | 56 d (same as this employer) |
| Median salary (USD postings) | — | $221k |
Skills observed across this category: LLM training, CUDA, PyTorch, performance modeling, GPU architecture
Who's hiring in this category
- NVIDIA (this employer) · 117 open roles · median 56 d
- AMD · 53 open roles · median 55 d
- Intel Corporation · 23 open roles · median 13 d
- Qualcomm · 18 open roles · median 126 d
- Arm Holdings · 5 open roles · median 119 d
- Graphcore · 4 open roles · median 1 d
How we counted: 238 open Infrastructure/Platform Software (GPU Software Stack) roles from 20 employers tracked in the SemiconductorJobs index, counted 22 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.