Senior Software Engineer, Spatial Intelligence and Foundation Models
$184,000 - $356,500 USD yearly
Originally posted 16 July 2026 by the employer.
About the role
This role joins the Isaac Spatial Intelligence team within the Isaac Engineering organization to develop geometric and semantic understanding and reasoning systems for robotics. You will work with the Cosmos and GR00T teams to build perception systems that operate on physical robots, in simulation, and across foundation model training pipelines.
What you'll do
- Design, implement, and deploy algorithms for spatial understanding, including SLAM, structure-from-motion, optical flow, scene flow, object reconstruction, and training VLMs on spatial reasoning skills.
- Develop perception, mapping, and reasoning systems running on robots, in simulation, and within data pipelines for training foundation models.
- Combine classical multi-view geometry and optimization with deep learning approaches for geometric computer vision.
- Train and evaluate vision-language models on skills relevant to robotics.
- Collaborate with the Cosmos and GR00T teams, as well as Isaac Sim/Lab, Platform, and SQA teams, to deploy and validate capabilities on physical robots and at-scale simulations.
- Partner cross-functionally with product, hardware, and software teams to deliver prototypes, open source software contributions, patents, and publications.
What you'll need
- PhD or Master's degree in Computer Science, Robotics, or a related field (or equivalent experience).
- 8+ years of experience working on computer vision, robotics, or deep learning technologies.
- Foundation in 3D geometric computer vision: multi-view geometry, visual odometry/SLAM, structure-from-motion, or dense correspondence (optical flow, scene flow, stereo).
- Hands-on programming skills in Python and/or C++, with experience using deep learning frameworks such as PyTorch, JAX, or TensorFlow.
- Experience training and evaluating deep learning models for perception tasks.
- Proficiency using AI coding agents and agentic workflows (e.g., Claude Code, Cursor, Codex) for development, testing, and experimentation.
Skills: robotics software, geometric and semantic understanding, SLAM, VLMs, foundation models
More semiconductor jobs: NVIDIA jobs · AI chip design jobs · California jobs
This role has been open 106 days — well above the 92-day median for AI/ML Hardware Engineering roles.
AI/ML Hardware Engineering · AI ML Hardware
|
Open roles in category
478
|
Median days open
92 d
|
Category median salary (all employers)
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | NVIDIA | All employers we track in this specialty (478 roles · 77 employers) |
|---|---|---|
| Open roles in this specialty | 102 | 478 |
| Open roles in the wider Software, Firmware & Systems family | 1117 | 6358 · 144 employers |
| Median days open | 74 d | 92 d (−18 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: robotics software, geometric and semantic understanding, SLAM, VLMs, foundation models
Who's hiring in this category
- Qualcomm · 95 open roles · median 122 d
- NVIDIA (this employer) · 88 open roles · median 66 d
- AMD · 32 open roles · median 114 d
- Mobileye · 19 open roles · median 89 d
- Micron Technology · 18 open roles · median 74 d
- Analog Devices · 15 open roles · median 49 d
How we counted: 478 open AI/ML Hardware Engineering (AI ML Hardware) roles from 77 employers tracked in the SemiconductorJobs index, counted 31 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.