Principal AI Software Engineer - CA, San Jose, United States
$210,000 - $360,000 USD yearly
Originally posted 22 April 2026 by the employer.
About the role
AMD AI Group is seeking a technical leader for OneROCm to drive a unified ROCm software stack across AMD's product portfolio, including Instinct, Radeon, Ryzen, Embedded, Game Consoles, and Autonomous Driving platforms. The role shapes end-to-end ROCm software spanning compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers.
What you'll do
- Collaborate across hardware architecture, compiler, math libraries, kernel, and framework teams to influence future silicon features based on evolving AI workload trends. - Deliver execution roadmaps for the AI software stack across all AMD products. - Lead profiling, analysis, and tuning of large-scale models, including LLMs, Diffusion, Multimodal, and MoE architectures, to ensure out-of-the-box performance on AMD hardware. - Drive the development of tools and frameworks for performance estimation, modeling, and automated reporting. - Partner with customers and hyperscalers to understand workload requirements and deliver architectural software optimizations. - Mentor engineers and contribute to the ROCm open-source ecosystem.
What you'll need
- Bachelor of Science degree in Electrical Engineering, Computer Architecture, Computer Science, or a related field. - Deep expertise in at least one major area of the AI/ML software stack, with hands-on capability across compilers, kernels, runtime, or performance optimization layers. - Experience with hardware-software co-design to optimize performance across workloads. - Technical breadth spanning silicon, system software, AI/ML frameworks, libraries, and application enablement.
Nice to have
- Knowledge of GPU architectures and foundational knowledge of CPU architecture. - Experience with GPU programming environments such as ROCm, CUDA, or OpenCL. - Experience building high-performance products across the full product lifecycle. - Experience with operating systems (OS) and device driver development. - Master's or PhD degree with emphasis in Electrical Engineering, Computer Architecture, or Computer Science.
Skills: ROCm software, hardware-software co-design, AI workload optimization, compilers, kernels, libraries
This role has been open 184 days — well above the 54-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
244
|
Median days open
54 d
|
Median salary
$221k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | AMD | All employers we track in this specialty (244 roles · 20 employers) |
|---|---|---|
| Open roles in this specialty | 51 | 244 |
| Open roles in the wider Software, Firmware & Systems family | 389 | 6250 · 144 employers |
| Median days open | 54 d | 54 d (same as this employer) |
| Median salary (USD postings) | — | $221k |
Skills observed across this category: ROCm software, hardware-software co-design, AI workload optimization, compilers, kernels, libraries
Who's hiring in this category
- NVIDIA · 122 open roles · median 58 d
- AMD (this employer) · 51 open roles · median 54 d
- Intel Corporation · 26 open roles · median 14 d
- Qualcomm · 18 open roles · median 129 d
- Arm Holdings · 5 open roles · median 122 d
- Graphcore · 4 open roles · median 4 d
How we counted: 244 open Infrastructure/Platform Software (GPU Software Stack) roles from 20 employers tracked in the SemiconductorJobs index, counted 25 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.
Similar Jobs
Career Accelerator Program - Software Engineer - Dallas, TX, United States
Texas Instruments · Dallas, TX, United States
Senior Unreal Engine Developer Technology Engineer - California, Folsom, United States
Intel Corporation · Remote friendly (US, California, Folsom, United States)