Director of AI Workload Intelligence - San Jose, CA, United States
$250,000 - $300,000 USD yearly
Originally posted 1 September 2026 by the employer.
About the role
This Director-level position leads global initiatives to analyze LLM and multimodal workloads for HBF applicability, bridging AI intelligence with memory strategy.
What you'll do
- Lead global collaboration and drive AI workload-based HBF technology development from research to PoC and productization.
- Analyze AI models, algorithms, and workload trends for HBF applicability.
- Classify HBF-relevant memory objects such as weights, KV cache, activations, embeddings, adapters, and MoE experts.
- Define model-level criteria for data placement, caching, prefetching, and offload decisions.
- Analyze HBF integration points in vLLM, SGLang, TensorRT-LLM, PyTorch, and ONNX Runtime.
- Develop memory-use taxonomy and HBF applicability criteria.
What you'll need
- Proven experience leading global AI system architecture initiatives and cross-functional teams.
- Hands-on experience in AI inference systems, ML systems, LLM serving, AI model analysis, AI framework/runtime analysis, or heterogeneous accelerator software.
- Strong understanding of Transformers, LLMs, MoE, recommendation models, embedding/retrieval workloads, and multimodal inference.
- Experience with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton Inference Server, or equivalent AI inference stacks.
- Experience in latency, throughput, token throughput, memory footprint, bandwidth, and data movement analysis.
Skills: AI workload, HBF technology, LLMs, AI inference SW Stack, memory objects
This role has been open 36 days — well below the 75-day median for AI/ML Hardware Engineering roles.
AI/ML Hardware Engineering · AI ML Hardware
|
Open roles in category
521
|
Median days open
75 d
|
Median salary
$235k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | SK Hynix America | All employers we track in this specialty (521 roles · 76 employers) |
|---|---|---|
| Open roles in this specialty | 3 | 521 |
| Open roles in the wider Software, Firmware & Systems family | 7 | 6049 · 146 employers |
| Median days open | 193 d | 75 d (+118 d vs this employer) |
| Median salary (USD postings) | — | $235k |
Skills observed across this category: AI workload, HBF technology, LLMs, AI inference SW Stack, memory objects
Who's hiring in this category
- Qualcomm · 100 open roles · median 112 d
- NVIDIA · 89 open roles · median 51 d
- AMD · 41 open roles · median 71 d
- Micron Technology · 30 open roles · median 60 d
- Mobileye · 19 open roles · median 70 d
- Analog Devices · 16 open roles · median 33 d
How we counted: 521 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 8 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.