Skip to main content
Samsung Semiconductor

Senior Staff Performance Engineer

Samsung Semiconductor San Jose, California, United States 2 months ago
AI/ML Hardware

$189,000 - $301,000 USD yearly

Originally posted September 29, 2026 by the employer.

About the role

The Senior Staff Performance Engineer in the AGI Computing Lab solves system-level challenges posed by the computational and memory requirements of AI/ML workloads. The role focuses on scalable platforms across memory, computing, and interconnect technologies to balance hardware and software components.

What you'll do

  • Build and operate AI environments reflecting production workloads, including agentic workflows, distributed inference, disaggregated serving architectures, and MoE deployments.
  • Collect workload traces, runtime telemetry, and performance data across the software stack from AI applications.
  • Characterize and compare workloads across environments and platforms to identify compute, memory, communication, and scheduling bottlenecks across applications, runtimes, hosts, and devices.
  • Communicate findings to hardware architects, systems engineers, and software researchers through reports, presentations, and architecture reviews.
  • Define performance evaluation methodologies and benchmarking standards for adoption across hardware and software teams, setting the technical direction for workload characterization.

What you'll need

  • BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field, with required industry experience: 15+ years with a BS, 13+ years with an MS, or 10+ years with a PhD in performance engineering, AI systems, distributed systems, or high-performance computing.
  • Ability to interpret workload traces, runtime telemetry, and performance data to identify bottlenecks and analyze interactions between workload characteristics and software/hardware layers.
  • Knowledge of the LLM software stack, including serving and scheduling, attention and KV-cache management, kernel launch and memory-transfer overhead, collective communication, accelerator compute throughput, memory hierarchy, memory bandwidth, and interconnect topology.
  • Experience characterizing agentic workflows, long-context processing, MoE models, or disaggregated inference deployments.
  • Experience profiling and optimizing AI workloads on NVIDIA GPU platforms using Nsight Systems and Nsight Compute.
  • Experience analyzing multi-node AI deployments, including synchronization overhead, load imbalance, communication patterns, and scaling behavior.
  • Experience with AI frameworks or serving systems such as PyTorch, vLLM, SGLang, TensorRT-LLM, DeepSpeed, Ray, or Megatron-LM.

Skills: AI/ML workloads, performance data, hardware architects, LLM software stack, NVIDIA GPU platforms

More semiconductor jobs: Samsung Semiconductor jobs · AI chip design jobs · San Jose jobs

Market context

Tracked in our index since 6 Oct 2026. This is our observation date, not the employer posting date. Specialty: AI/ML Hardware Engineering (AI ML Hardware). 481 active roles in this specialty at 76 employers in our index, as of 17 Nov 2026.

How we counted: postings read from employer career sites. How we count

Samsung Semiconductor

Samsung Semiconductor

Apply now
San Jose, California, United States
On-site
$189,000 - $301,000 USD yearly
2 months ago

Share this job