Embedded & Systems Software
Originally posted September 23, 2026 by the employer.
About the role
This role involves developing inferencing software for TensorRT LLM and TensorRT Edge LLM projects.
What you'll do
- Craft and develop robust inferencing software that can be scaled to multiple platforms.
- Perform performance analysis, optimization, and tuning.
- Closely follow academic developments in artificial intelligence and large language models.
- Provide feedback into architecture and hardware design and development.
- Collaborate across the company to guide the direction of machine learning inferencing.
- Publish key results in scientific conferences.
What you'll need
- Pursuing Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree.
- Relevant software development experience.
- Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
- Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models.
- Experience working with deep learning frameworks like TensorFlow and PyTorch.
Skills: TensorRT LLM, inferencing software, deep learning frameworks, GPU-accelerated, AI and Compute systems
More semiconductor jobs: NVIDIA jobs
Market context
Tracked in our index since 23 Sept 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (GPU Software Stack). 343 active roles in this specialty at 25 employers in our index, as of 18 Nov 2026.
How we counted: postings read from employer career sites. How we count