Senior staff AI/HPC Infrastructure Engineer
$179,700 - $305,500 USD yearly
Work on GPU computing platforms and memory-centric AI architectures utilizing vLLM, TensorRT-LLM, RDMA, and InfiniBand.
Originally posted 27 October 2026 by the employer.
About the role
The AI/HPC Infrastructure Engineer modifies and operates GPU computing platforms for AI training, inference, and memory-system research. The role supports the development of HBF, SSD, and memory-centric AI systems through hardware/software co-design and workload analysis.
What you'll do
- Build and operate AI testbeds supporting 8 to 100+ GPU environments, managing server, networking, storage, and software infrastructure.
- Install and optimize LLM serving frameworks including vLLM, NVIDIA Dynamo, TensorRT-LLM, Triton Inference Server, and SGLang.
- Capture workload traces from training and inference systems to analyze memory bandwidth, KV-cache growth, storage access patterns, and network traffic.
- Evaluate system bottlenecks across SSD, networking, and GPU interconnects while prototyping disaggregated memory and storage architectures.
- Build simulation environments and digital-twin platforms based on real workload traces to evaluate memory products prior to silicon availability.
- Collaborate with universities, national laboratories, cloud service providers, and system OEMs to evaluate architectures and publish technical findings.
What you'll need
- Hands-on experience with Linux, Kubernetes, Docker, Slurm, Python, and GPU cluster administration.
- Experience deploying and optimizing LLM serving stacks including vLLM, NVIDIA Dynamo, TensorRT-LLM, Triton, or SGLang.
- Working knowledge of scale-out networking technologies including InfiniBand, RoCE, RDMA, NCCL, and multi-node inference.
- Technical background in distributed systems engineering, AI accelerator architecture, memory hierarchy optimization, and SSD architecture.
- Experience with AI performance modeling and hardware/software co-design.
Skills: vLLM, GPU cluster, RDMA, InfiniBand, TensorRT-LLM
More semiconductor jobs: SanDisk jobs · California jobs
This role has been open 0 days — well below the 51-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1010
|
Median days open
51 d
|
Category median salary (all employers)
$229k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | SanDisk | All employers we track in this specialty (1010 roles · 90 employers) |
|---|---|---|
| Open roles in this specialty | 7 | 1010 |
| Open roles in the wider Software, Firmware & Systems family | 67 | 6275 · 144 employers |
| Median days open | 0 d | 51 d (−51 d vs this employer) |
| Median salary (USD postings) | — | $229k |
Skills observed across this category: vLLM, GPU cluster, RDMA, InfiniBand, TensorRT-LLM
Who's hiring in this category
- NVIDIA · 286 open roles · median 50 d
- Qualcomm · 54 open roles · median 68 d
- AMD · 51 open roles · median 29 d
- Graphcore · 49 open roles · median 105 d
- Intel Corporation · 46 open roles · median 15 d
- Cerebras · 36 open roles · median 94 d
How we counted: 1010 open Infrastructure/Platform Software (Infrastructure Platform) roles from 90 employers tracked in the SemiconductorJobs index, counted 30 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.