Systems Software Engineer - AI Infrastructure - Milpitas, CA, United States
$136,300 - $231,700 USD yearly
Originally posted 17 July 2026 by the employer.
About the role
As a Systems Software Engineer - AI Infrastructure, you will research, evaluate, and develop hardware and software technologies that enable large-scale AI and machine learning workloads across KLA. You will design and build infrastructure that powers model training, inference, networking, storage, data protection, and emerging agentic AI systems.
What you'll do
- Architect, deploy, and operate scalable, secure AI platforms, distributed training environments, and model serving systems. - Evaluate emerging technologies in AI infrastructure, compute, storage, networking, orchestration, and security to develop reference designs. - Bring up, integrate, and lead AI compute infrastructure while diagnosing hardware, firmware, operating system, and platform issues. - Design and maintain high-performance storage, networking, and data pipelines supporting large-scale AI workloads. - Develop observability and monitoring solutions, optimize AI workload performance, and ensure infrastructure meets reliability targets. - Implement security-by-design principles including encryption, identity and access management, secrets management, and container security.
What you'll need
- Degree in Computer Science, Computer Engineering, or related field (Doctorate + 0 years, Master's + 3 years, or Bachelor's + 5 years of related work experience). - 5–8 years of experience in systems engineering, DevOps, or ML infrastructure. - Hands-on experience building AI/GPU clusters and managing GPU/TPU optimization. - Working knowledge of Linux administration, Kubernetes/Docker, Slurm, Ray, and high-speed networking. - Automation and scripting proficiency in Bash, Python, CI/CD pipelines, and infrastructure as code (IaC). - Familiarity with AI frameworks and workloads such as PyTorch, TensorFlow, model training, fine-tuning, and RAG pipelines.
Skills: AI platforms, distributed training environments, GPU/TPU optimization, MLOps
This role has been open 97 days — well above the 50-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
988
|
Median days open
50 d
|
Median salary
$235k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | KLA Corporation | All employers we track in this specialty (988 roles · 87 employers) |
|---|---|---|
| Open roles in this specialty | 22 | 988 |
| Open roles in the wider Software, Firmware & Systems family | 207 | 6222 · 145 employers |
| Median days open | 88 d | 50 d (+38 d vs this employer) |
| Median salary (USD postings) | — | $235k |
Skills observed across this category: AI platforms, distributed training environments, GPU/TPU optimization, MLOps
Who's hiring in this category
- NVIDIA · 286 open roles · median 47 d
- Qualcomm · 62 open roles · median 50 d
- AMD · 56 open roles · median 21 d
- Intel Corporation · 45 open roles · median 13 d
- Graphcore · 44 open roles · median 95 d
- Cerebras · 38 open roles · median 85 d
How we counted: 988 open Infrastructure/Platform Software (Infrastructure Platform) roles from 87 employers tracked in the SemiconductorJobs index, counted 20 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.