Embedded & Systems Software
$224,000 - $356,500 USD yearly
Originally posted October 29, 2026 by the employer.
About the role
Software Engineer, ML Performance focused on optimizing performance at scale across distributed training and inference workloads.
What you'll do
- Analyze the performance of distributed training and inference workloads throughout the entire stack: model and framework, data loading and checkpointing, compiler and kernels, CUDA and NCCL, host and network.
- Define performance metrics tracked across a fleet of GPUs, isolate factors needed for debugging, and determine priority signals for platform collection.
- Drive regression analysis by segmenting workloads across machines, versions, and configurations to isolate root causes into reusable analysis methods.
- Evaluate automated diagnoses by assessing accuracy, identifying misleading results or missed issues, and establishing labeled test cases.
- Work with build partners on production workloads to implement improvements and integrate missing product requirements into the roadmap.
What you'll need
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
- 12+ years of relevant software engineering experience, including hands-on optimization of GPU training or inference workloads in production.
- Demonstrated performance work across multiple layers of the stack with documented baselines, evidence, alternative explanations, and validated outcomes.
- Experience diagnosing performance across multiple jobs, machines, or tenants.
- Familiarity with framework, runtime, and compiler interfaces to determine signal measurement locations.
- Strong programming and debugging skills with proficiency in Python and CUDA.
Skills: CUDA, GPU, NCCL, PyTorch, performance optimization
More semiconductor jobs: NVIDIA jobs
Market context
Tracked in our index since 30 Oct 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (GPU Software Stack). 344 active roles in this specialty at 25 employers in our index, as of 19 Nov 2026.
How we counted: postings read from employer career sites. How we count