AI Computing Software Development Intern, LLM Inference - 2027
Originally posted 23 September 2026 by the employer.
About the role
This role involves developing inferencing software for TensorRT LLM and TensorRT Edge LLM projects.
What you'll do
- Craft and develop robust inferencing software that can be scaled to multiple platforms.
- Perform performance analysis, optimization, and tuning.
- Closely follow academic developments in artificial intelligence and large language models.
- Provide feedback into architecture and hardware design and development.
- Collaborate across the company to guide the direction of machine learning inferencing.
- Publish key results in scientific conferences.
What you'll need
- Pursuing Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree.
- Relevant software development experience.
- Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
- Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models.
- Experience working with deep learning frameworks like TensorFlow and PyTorch.
Skills: TensorRT LLM, inferencing software, deep learning frameworks, GPU-accelerated, AI and Compute systems
This role has been open 0 days — well below the 49-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · GPU Software Stack
|
Open roles in category
221
|
Median days open
49 d
|
Median salary
$221k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (221 roles · 19 employers) |
|---|---|---|
| Open roles in this specialty | 116 | 221 |
| Open roles in the wider Software, Firmware & Systems family | 1001 | 5948 · 143 employers |
| Median days open | 47 d | 49 d (−2 d vs this employer) |
| Median salary (USD postings) | — | $221k |
Skills observed across this category: TensorRT LLM, inferencing software, deep learning frameworks, GPU-accelerated, AI and Compute systems
Who's hiring in this category
- NVIDIA (this employer) · 109 open roles · median 47 d
- AMD · 57 open roles · median 43 d
- Qualcomm · 20 open roles · median 118 d
- Intel Corporation · 9 open roles · median 41 d
- Arm Holdings · 5 open roles · median 90 d
- Bolt Graphics · 3 open roles · median 49 d
How we counted: 221 open Infrastructure/Platform Software (GPU Software Stack) roles from 19 employers tracked in the SemiconductorJobs index, counted 23 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.