Senior Compiler Software Development Engineer - AI/ML - CA, San Jose, United States
Originally posted 10 August 2026 by the employer.
Contribute to the ROCm software ecosystem and ONNX Runtime execution stack on AMD GPU platforms.
About the role
This role focuses on the ROCm software ecosystem and ONNX Runtime execution stack.
What you'll do
- Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
- Develop scalable solutions that improve portability and performance across AMD GPU architectures.
- Implement, validate, and maintain ONNX operators and microbenchmark test suites.
- Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.
- Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.
- Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.
What you'll need
- Strong proficiency in C++ and object-oriented software development.
- Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.
- Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.
- Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.
- Experience profiling and optimizing performance-critical software systems.
- Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.
Nice to have
- Strong analytical, communication, and problem-solving skills.
Skills: AI/ML Compiler, ROCm software ecosystem, ONNX Runtime, GPU platforms, MLIR
This role has been open 68 days — well above the 57-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
229
|
Median days open
57 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | AMD | All employers we track in this specialty (229 roles · 20 employers) |
|---|---|---|
| Open roles in this specialty | 50 | 229 |
| Open roles in the wider Software, Firmware & Systems family | 406 | 6114 · 145 employers |
| Median days open | 59 d | 57 d (+2 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: AI/ML Compiler, ROCm software ecosystem, ONNX Runtime, GPU platforms, MLIR
Who's hiring in this category
- NVIDIA · 114 open roles · median 55 d
- AMD (this employer) · 50 open roles · median 59 d
- Intel Corporation · 22 open roles · median 8 d
- Qualcomm · 18 open roles · median 121 d
- Arm Holdings · 5 open roles · median 114 d
- d-Matrix · 2 open roles · median 122 d
How we counted: 229 open Infrastructure/Platform Software (GPU Software Stack) roles from 20 employers tracked in the SemiconductorJobs index, counted 17 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.