Skip to main content
AMD

Sr. AI/ML Platform Engineer - CA, Santa Clara, United States

AMD US, CA, Santa Clara, United States Full-time 4 months ago
Embedded & Systems Software

Originally posted 8 July 2026 by the employer.

ROCm/HIP

About the role

Build the platform layer that makes AI-for-engineering workflows scalable, reliable, and reproducible. Focus on the infrastructure supporting large-scale agent execution, distributed training and inference, experiment tracking, and GPU cluster utilization across the Blueprint framework.

What you'll do

- Build and operate the shared AI platform for agentic engineering workflows, including job submission, scheduling, orchestration, retries, logging, artifact storage, and experiment tracking. - Develop reliable infrastructure for distributed training, distributed inference, batch evaluation, and large-scale agent rollout across GPU clusters. - Support scalable integrations with compilers, ROCm/HIP tooling, profilers, simulators, EDA tools, vLLM, SGLang, and internal engineering systems. - Improve GPU cluster utilization, scheduling efficiency, reliability, quota management, and workload isolation. - Maintain artifact systems for generated kernels, RTL edits, traces, logs, profiler outputs, benchmark results, simulator outputs, and formal verification artifacts. - Partner with Applied AI Engineers to make Blueprint harnesses reusable across kernel optimization, RTL optimization, verification, firmware, and CPU/GPU performance workflows.

What you'll need

- Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Machine Learning, or related field, or equivalent practical experience. - Strong programming skills in Python and one or more systems languages such as C++, Go, or Rust. - Experience building ML platforms, AI infrastructure, distributed systems, workflow orchestration, experiment platforms, GPU cluster infrastructure, or developer platforms. - Strong understanding of job scheduling, distributed workloads, logging, monitoring, reliability, storage systems, and production operations. - Experience with Kubernetes, Ray, Slurm, workflow engines, containerization, CI/CD, data pipelines, or large-scale compute orchestration. - Strong debugging skills across distributed systems, GPU workloads, storage systems, networking, containers, and production infrastructure.

Nice to have

- Master's or PhD degree with work in ML systems, reinforcement learning, distributed systems, GPU computing, or AI infrastructure. - Experience with GPU platforms, ROCm/HIP, CUDA, profiling, kernel benchmarking, model serving, or distributed training/inference. - Experience with vLLM, SGLang, Triton, PyTorch, JAX, Ray, Kubernetes, Slurm, MLflow, Weights & Biases, or similar systems. - Experience supporting LLM agents, tool-use systems, large-scale sampling, or automated program optimization workflows. - Familiarity with compiler, profiler, simulator, formal verification, EDA, firmware, or hardware performance workflows. - Experience operating shared GPU clusters or high-performance ML infrastructure in a multi-user research environment.

Skills: AI / ML Platform, GPU cluster utilization, distributed training, experiment management, ROCm/HIP, hardware domain experts

Market context

This role has been open 103 days — well above the 50-day median for Infrastructure/Platform Software roles.

Infrastructure/Platform Software · Infrastructure Platform

Open roles in category
998
Median days open
50 d
Median salary
$235k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How AMD compares in Infrastructure/Platform Software hiring
Metric AMD All employers we track in this specialty (998 roles · 89 employers)
Open roles in this specialty 58 998
Open roles in the wider Software, Firmware & Systems family 410 6222 · 145 employers
Median days open 22 d 50 d (−28 d vs this employer)
Median salary (USD postings) — $235k

Skills observed across this category: AI / ML Platform, GPU cluster utilization, distributed training, experiment management, ROCm/HIP, hardware domain experts

Who's hiring in this category

  • NVIDIA · 290 open roles · median 47 d
  • Qualcomm · 62 open roles · median 51 d
  • AMD (this employer) · 58 open roles · median 22 d
  • Graphcore · 50 open roles · median 96 d
  • Intel Corporation · 44 open roles · median 13 d
  • Cerebras · 35 open roles · median 86 d

How we counted: 998 open Infrastructure/Platform Software (Infrastructure Platform) roles from 89 employers tracked in the SemiconductorJobs index, counted 21 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.

Apply now
US, CA, Santa Clara, United States
On-site
Full-time
4 months ago

Share this job