Skip to main content
NVIDIA

AI Computing Software Development Intern, LLM Inference - 2027

NVIDIA Shanghai, China; Beijing, China Internship 2 months ago
Embedded & Systems Software

Originally posted September 23, 2026 by the employer.

About the role

This role involves developing inferencing software for TensorRT LLM and TensorRT Edge LLM projects.

What you'll do

  • Craft and develop robust inferencing software that can be scaled to multiple platforms.
  • Perform performance analysis, optimization, and tuning.
  • Closely follow academic developments in artificial intelligence and large language models.
  • Provide feedback into architecture and hardware design and development.
  • Collaborate across the company to guide the direction of machine learning inferencing.
  • Publish key results in scientific conferences.

What you'll need

  • Pursuing Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree.
  • Relevant software development experience.
  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
  • Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models.
  • Experience working with deep learning frameworks like TensorFlow and PyTorch.

Skills: TensorRT LLM, inferencing software, deep learning frameworks, GPU-accelerated, AI and Compute systems

More semiconductor jobs: NVIDIA jobs

Market context

Tracked in our index since 23 Sept 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (GPU Software Stack). 343 active roles in this specialty at 25 employers in our index, as of 18 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Shanghai, China; Beijing, China
On-site
Internship
2 months ago

Share this job