Skip to main content
AMD

GPU Kernel Engineer

AMD Santa Clara, CA, United States Full-time 2 days ago
Embedded & Systems Software

Optimize deep learning frameworks and high-performance GPU kernels using HIP and Triton on AMD platforms.

Originally posted November 17, 2026 by the employer.

About the role

This role focuses on optimizing and developing deep learning frameworks for AMD GPUs, enhancing GPU kernel performance for training and inference across multi-GPU and multi-node systems.

What you'll do

  • Enhance the performance of deep learning frameworks such as TensorFlow, PyTorch, and SGLang on AMD GPUs via upstream open-source contributions.
  • Profile and tune large-scale training and inference models for performance on AMD hardware.
  • Design, implement, and optimize GPU kernels using HIP, Triton, or related tools for AI operator efficiency.
  • Collaborate with internal compiler and GPU math library teams to align kernel-level optimizations with full-stack performance targets.
  • Support optimization, feature development, and scaling of the SGLang LLM framework across AMD GPU platforms.
  • Tune and scale workloads across multi-GPU and multi-node environments, including inference parallelism and collective communication strategies.

What you'll need

  • Bachelor's degree and/or working towards a Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Experience with C++ development within Linux environments.
  • Understanding of software engineering practices in debugging, profiling, test-driven development, and CI integration.

Nice to have

  • Proficiency in C++ and/or Python, with the ability to debug, profile, and optimize performance-critical code.
  • Hands-on experience with SGLang or similar LLM inference frameworks.
  • Background in compiler design or familiarity with technologies like LLVM, MLIR, or ROCm.
  • Experience running and scaling workloads on large-scale, heterogeneous clusters (CPU + GPU) using distributed training or inference strategies.
  • Experience contributing to or integrating optimizations into deep learning frameworks such as PyTorch or TensorFlow.
  • Working knowledge of HIP, CUDA, or other GPU programming models, with experience in GCN or CDNA architecture.

More semiconductor jobs: AMD jobs · Embedded software jobs · California jobs

Market context

Tracked in our index since 18 Nov 2026. This is our observation date, not the employer posting date. Specialty: Systems Software Engineering (Systems Software). 720 active roles in this specialty at 78 employers in our index, as of 19 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Santa Clara, CA, United States
On-site
Full-time
2 days ago

Share this job