Skip to main content
NVIDIA

Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

NVIDIA Santa Clara, CA, United States 4 months ago
AI/ML Hardware

$184,000 - $356,500 USD yearly

Originally posted July 20, 2026 by the employer.

About the role

This role involves designing and productizing NVIDIA's autonomous driving perception stack, working on the core 3D obstacle perception pipeline. You will contribute to architecture, algorithm design, and hands-on implementation using transformer-based, multi-modal, and vision-language techniques.

What you'll do

  • Develop and improve the technical design, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous driving functionalities using CNN and transformer-based architectures.
  • Design and implement advanced 3D perception models using multi-camera inputs and/or multi-sensor fusion (camera, radar, lidar) for obstacle detection and tracking, including BEV and transformer-based 3D perception.
  • Build production-grade deep learning models using techniques such as large-scale pretraining, distillation, and parameter-efficient fine-tuning (e.g., LoRA).
  • Define and maintain KPI frameworks to quantify perception performance, analyzing large-scale real and synthetic datasets to improve accuracy, robustness, and efficiency.
  • Contribute to perception data strategy and annotation workflows, including active learning, auto-labeling, and vision-language models (VLMs).
  • Collaborate with safety, systems, and software teams to meet product requirements for safety, latency, resource usage, and software robustness.

What you'll need

  • PhD with 4+ years, MS with 6+ years, or BS with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
  • Hands-on experience developing deep learning–based perception or related systems, with strong proficiency in frameworks such as PyTorch and a track record of deploying models to production.
  • Proven experience in data-driven development, collaborating with data, labeling, and ground-truth teams on data strategy and iterative model improvement.
  • Strong programming skills in Python and/or C++, with experience building reliable, high-performance, production-quality software.

Skills: 3D obstacle perception, deep learning models, PyTorch, Python/C++, computer vision, autonomous driving

More semiconductor jobs: NVIDIA jobs · AI chip design jobs

Market context

Tracked in our index since 21 Jul 2026. This is our observation date, not the employer posting date. Specialty: AI/ML Hardware Engineering (AI ML Hardware). 480 active roles in this specialty at 76 employers in our index, as of 18 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Santa Clara, CA, United States
On-site
$184,000 - $356,500 USD yearly
4 months ago

Share this job