Skip to main content
SK Hynix America

Director of AI Workload Intelligence - San Jose, CA, United States

SK Hynix America San Jose, CA, United States 3 months ago
AI/ML Hardware

$250,000 - $300,000 USD yearly

Originally posted 1 September 2026 by the employer.

About the role

This Director-level position leads global initiatives to analyze LLM and multimodal workloads for HBF applicability, bridging AI intelligence with memory strategy.

What you'll do

  • Lead global collaboration and drive AI workload-based HBF technology development from research to PoC and productization.
  • Analyze AI models, algorithms, and workload trends for HBF applicability.
  • Classify HBF-relevant memory objects such as weights, KV cache, activations, embeddings, adapters, and MoE experts.
  • Define model-level criteria for data placement, caching, prefetching, and offload decisions.
  • Analyze HBF integration points in vLLM, SGLang, TensorRT-LLM, PyTorch, and ONNX Runtime.
  • Develop memory-use taxonomy and HBF applicability criteria.

What you'll need

  • Proven experience leading global AI system architecture initiatives and cross-functional teams.
  • Hands-on experience in AI inference systems, ML systems, LLM serving, AI model analysis, AI framework/runtime analysis, or heterogeneous accelerator software.
  • Strong understanding of Transformers, LLMs, MoE, recommendation models, embedding/retrieval workloads, and multimodal inference.
  • Experience with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, ONNX Runtime, Triton Inference Server, or equivalent AI inference stacks.
  • Experience in latency, throughput, token throughput, memory footprint, bandwidth, and data movement analysis.

Skills: AI workload, HBF technology, LLMs, AI inference SW Stack, memory objects

Market context

This role has been open 36 days — well below the 75-day median for AI/ML Hardware Engineering roles.

AI/ML Hardware Engineering · AI ML Hardware

Open roles in category
521
Median days open
75 d
Median salary
$235k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How SK Hynix America compares in AI/ML Hardware Engineering hiring
Metric SK Hynix America All employers we track in this specialty (521 roles · 76 employers)
Open roles in this specialty 3 521
Open roles in the wider Software, Firmware & Systems family 7 6049 · 146 employers
Median days open 193 d 75 d (+118 d vs this employer)
Median salary (USD postings) — $235k

Skills observed across this category: AI workload, HBF technology, LLMs, AI inference SW Stack, memory objects

Who's hiring in this category

  • Qualcomm · 100 open roles · median 112 d
  • NVIDIA · 89 open roles · median 51 d
  • AMD · 41 open roles · median 71 d
  • Micron Technology · 30 open roles · median 60 d
  • Mobileye · 19 open roles · median 70 d
  • Analog Devices · 16 open roles · median 33 d

How we counted: 521 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 8 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.

SK Hynix America

SK Hynix America

Apply now
San Jose, CA, United States
On-site
$250,000 - $300,000 USD yearly
3 months ago

Share this job