Fellow, AI Performance Software Architect - CA, Santa Clara, United States
$234,500 - $402,000 USD yearly
Originally posted 10 June 2026 by the employer.
About the role
AMD is searching for an AI Software Engineer to enable and optimize the software ecosystem for GPU computational accelerators. You will work with a team of Software Engineers to enable DL models, libraries, and applications for Instinct GPUs in both on-prem and Cloud environments.
What you'll do
- Enable and optimize DL models, libraries, and applications for Instinct GPUs across on-prem and Cloud environments. - Analyze and optimize the performance of AI software, identifying hardware bottlenecks and tuning performance to hit close to roofline. - Combine hardware capabilities with applications, libraries, frameworks, and SDKs to deliver custom AI software solutions. - Root-cause and resolve system-level and software performance issues across the AI software stack.
What you'll need
- Strong programming skills in C++ and Python. - Strong development experience in at least one major DL framework in inference, fine-tuning, and/or training. - Experience analyzing and optimizing the performance of AI software, understanding hardware bottlenecks, and hitting close to roofline. - Analytical and problem-solving skills for root-causing and addressing performance issues. - MS or PhD in Computer Science, Computer Engineering, or related equivalent with relevant experience.
Nice to have
- Experience developing software and system-level performance optimizations with a solid architecture understanding in GPUs. - Expertise in profiling tools across the AI SW stack (Torchprofiler, RocM profiler, Vtune, Nsight). - Experience in implementing and optimizing parallel methods on GPU accelerators (NCCL/RCCL, OpenMP, MPI). - Performance analysis skills for both CPU and GPU. - Experience with Singularity, Docker, and/or Kubernetes. - Experience with open-source software development including collaboration with community maintainers and submitting contributions, or publications in peer-reviewed ML conferences/journals.
Skills: AI Software Engineer, GPU computational accelerators, DL framework Pytorch Tensorflow, hardware bottlenecks, RocM profiler
This role has been open 135 days — well above the 56-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
242
|
Median days open
56 d
|
Median salary
$220k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | AMD | All employers we track in this specialty (242 roles · 20 employers) |
|---|---|---|
| Open roles in this specialty | 52 | 242 |
| Open roles in the wider Software, Firmware & Systems family | 393 | 6298 · 144 employers |
| Median days open | 52 d | 56 d (−4 d vs this employer) |
| Median salary (USD postings) | — | $220k |
Skills observed across this category: AI Software Engineer, GPU computational accelerators, DL framework Pytorch Tensorflow, hardware bottlenecks, RocM profiler
Who's hiring in this category
- NVIDIA · 120 open roles · median 56 d
- AMD (this employer) · 52 open roles · median 54 d
- Intel Corporation · 25 open roles · median 13 d
- Qualcomm · 18 open roles · median 127 d
- Arm Holdings · 5 open roles · median 120 d
- Graphcore · 4 open roles · median 2 d
How we counted: 242 open Infrastructure/Platform Software (GPU Software Stack) roles from 20 employers tracked in the SemiconductorJobs index, counted 23 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.
Similar Jobs
Infrastructure Systems Engineer - Arizona, Phoenix, United States
Intel Corporation · Remote friendly (US, Arizona, Phoenix, United States)
Infrastructure Storage Engineer - Arizona, Phoenix, United States
Intel Corporation · Remote friendly (US, Arizona, Phoenix, United States)