Sr. Staff Software Development Engineer - Collectives and Network optimization - CA, San Jose, United States
$178,500 - $306,000 USD yearly
Originally posted 25 June 2026 by the employer.
About the role
This senior-level engineering role is responsible for driving AMD's strategy, architecture, optimization, and tooling for AI pre-training and distributed inference performance on AMD GPUs. You will partner across hardware architecture, AI frameworks, compilers, runtime, ROCm, and developer tools to scale end-to-end performance analysis and optimization.
What you'll do
- Help set strategy and roadmap for AMD Collectives and Network optimizations. - Provide guidelines to customers on efficient network load-balancing, workload scheduling, and model sharding strategies. - Perform performance tuning, profiling, and analysis of large-scale models for LLM, diffusion, multimodal, RecSys, and generative AI across single-node and distributed configurations. - Participate in hardware-software co-design for future hardware optimizations, focusing on scale-up networks, NIC, and scale-out networks. - Develop and improve frameworks, tools, and infrastructure for performance estimation, modeling, and reporting. - Present performance analysis and modeling results to stakeholders and senior leadership with concrete recommendations.
What you'll need
- Deep knowledge of network, NIC, and GPU hardware architecture, software optimization, performance modeling, and AI frameworks. - Hands-on experience mapping model architecture to low-level software and hardware, including understanding the impact of each software stack layer on model performance. - Knowledge of generative model architecture, distributed inference, and deployment at scale. - Master's degree or PhD in Computer Science, Electrical Engineering, or a related field.
Nice to have
- Multiple years of technical experience in performance optimization, performance analysis, projection, and network hardware architecture. - Hands-on experience with AI frameworks such as PyTorch, JAX, vLLM, and SGLang. - Experience mentoring and coaching teams of researchers and engineers.
Skills: GPU, AI frameworks, performance optimization, ROCm, distributed inference, LLM
This role has been open 118 days — well above the 56-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
238
|
Median days open
56 d
|
Median salary
$221k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | AMD | All employers we track in this specialty (238 roles · 20 employers) |
|---|---|---|
| Open roles in this specialty | 52 | 238 |
| Open roles in the wider Software, Firmware & Systems family | 400 | 6298 · 145 employers |
| Median days open | 54 d | 56 d (−2 d vs this employer) |
| Median salary (USD postings) | — | $221k |
Skills observed across this category: GPU, AI frameworks, performance optimization, ROCm, distributed inference, LLM
Who's hiring in this category
- NVIDIA · 117 open roles · median 56 d
- AMD (this employer) · 53 open roles · median 55 d
- Intel Corporation · 23 open roles · median 13 d
- Qualcomm · 18 open roles · median 126 d
- Arm Holdings · 5 open roles · median 119 d
- Graphcore · 4 open roles · median 1 d
How we counted: 238 open Infrastructure/Platform Software (GPU Software Stack) roles from 20 employers tracked in the SemiconductorJobs index, counted 22 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.