Skip to main content
AMD

Senior Software Engineer - Efficient GenAI Models

AMD San Jose, CA, United States Full-time 8 hours ago
Embedded & Systems Software

About the role

The AI Models and Applications team at AMD is seeking an engineer to enable efficient Generative AI training and inference on AMD devices. You will work on scaling distributed training and inference optimization for generative AI applications including large language models, 3D world and action models, and image or video generation models.

What you'll do

  • Propose and apply techniques to support training and inference, including transformer architectures, parallelism strategies for training on large clusters, speculative decoding, and optimal KV-caching strategies.
  • Implement efficient architectures for Generative AI models for training and inference and demonstrate performance benefits on AMD platforms.
  • Work with open-source frameworks and communities, including PyTorch, JAX, vLLM, and SGLang, to integrate AMD-optimized models and libraries and publish training recipes.
  • Collaborate with software and hardware teams to co-optimize end-to-end performance on current and future AMD solutions.
  • Increase adoption of agentic workflows for optimizing and deploying Generative AI applications at scale on AMD platforms.
  • Publish and promote technical work at external venues and collaborate with researchers across industry and academia.

What you'll need

  • Hands-on experience with Generative AI applications in large language models (LLMs), 3D World and Action Models, or image/video generation models.
  • Experience training models at scale and developing efficient approaches for distributed training and inference on hardware devices.
  • Several years of experience in AI, deep learning, and related software development.
  • PhD or master’s degree in Computer Science, Electrical Engineering, Mathematics, or a related field.

Nice to have

  • Familiarity working with deep learning frameworks such as PyTorch, JAX, vLLM, SGLang, and MuJoCo.
  • Technical expertise in algorithmic innovation for efficient Generative AI applications across training and inference.
  • Expertise and publications in efficient model architectures, optimized training, innovative parallelism strategies, or low-precision training, including venues such as NeurIPS, CVPR, ECCV, ICCV, ICML, or ICLR.
  • Experience productizing Generative AI models and training foundation models at scale.

Skills: Generative AI, PyTorch, vLLM, Distributed Training, Inference Optimization

Market context
  • First seen in our index: 20 Nov 2026 (our observation date)
  • Last confirmed on the employer's career site: 20 Nov 2026
  • Specialty: Infrastructure/Platform Software (GPU Software Stack)
  • Comparable active jobs: 345 at 25 employers, as of 20 Nov 2026
  • Related specialties (Software, Firmware & Systems family): 6884 active jobs at 180 employers

View all AMD jobs · California jobs

How we counted: postings read from employer career sites; dates are our observations unless labelled as the employer's. How we count

Apply now
San Jose, CA, United States
On-site
Full-time
8 hours ago

Share this job