AI Computing Development Intern, TensorRT-LLM - 2027 - Shanghai, China
Originally posted 23 September 2026 by the employer.
This role focuses on building inferencing software for TensorRT-LLM.
About the role
This role involves crafting and developing robust inferencing software. You will contribute to the inferencing software used across NVIDIA product lines.
What you'll do
- Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance.
- Perform performance analysis, optimization, and tuning.
- Follow academic developments in artificial intelligence and feature update TensorRT-LLM.
- Provide feedback into the architecture and hardware design and development.
- Collaborate across the company to guide the direction of machine learning inferencing.
- Publish key results in scientific conferences.
What you'll need
- Pursuing a Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics, or a related computing-focused degree.
- Relevant software development experience.
- Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
- Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative, and recommender models.
- Experience working with deep learning frameworks like TensorFlow and PyTorch.
- Excellent written and oral communication skills in English.
Skills: TensorRT-LLM, inferencing software, deep learning, LLMs, TensorFlow and PyTorch
This role has been open 0 days — well below the 49-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
221
|
Median days open
49 d
|
Median salary
$221k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (221 roles · 19 employers) |
|---|---|---|
| Open roles in this specialty | 116 | 221 |
| Open roles in the wider Software, Firmware & Systems family | 1001 | 5948 · 143 employers |
| Median days open | 47 d | 49 d (−2 d vs this employer) |
| Median salary (USD postings) | — | $221k |
Skills observed across this category: TensorRT-LLM, inferencing software, deep learning, LLMs, TensorFlow and PyTorch
Who's hiring in this category
- NVIDIA (this employer) · 109 open roles · median 47 d
- AMD · 57 open roles · median 43 d
- Qualcomm · 20 open roles · median 118 d
- Intel Corporation · 9 open roles · median 41 d
- Arm Holdings · 5 open roles · median 90 d
- Bolt Graphics · 3 open roles · median 49 d
How we counted: 221 open Infrastructure/Platform Software (GPU Software Stack) roles from 19 employers tracked in the SemiconductorJobs index, counted 23 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.