Skip to main content
NVIDIA

Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

NVIDIA Santa Clara, CA, United States 5 months ago
AI/ML Hardware

$272,000 - $431,250 USD yearly

Originally posted July 5, 2026 by the employer.

About the role

As a Principal Perception Engineer, you will set the technical direction for 3D obstacle perception and lead the design and productization of NVIDIA's autonomous driving perception stack. This role focuses on hands-on architecture, algorithms, and implementation spanning CNNs, transformer-based models, multi-modal systems, and vision-language techniques.

What you'll do

  • Own the technical vision, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous driving functionalities.
  • Design and develop advanced 3D perception models using multi-camera inputs and multi-sensor fusion (camera, radar, lidar) for obstacle detection and tracking.
  • Lead the development of production-grade deep learning models using techniques such as large-scale pretraining, distillation, and parameter-efficient fine-tuning (e.g., LoRA).
  • Define KPI frameworks to quantify perception performance and analyze large-scale real and synthetic datasets to improve accuracy, robustness, and efficiency.
  • Lead perception data strategy, specifying data and labeling requirements, active learning, auto-labeling, and model-in-the-loop workflows.
  • Partner with safety, systems, and software teams to ensure perception solutions satisfy requirements for latency, resource usage, safety, and software robustness.

What you'll need

  • BS, MS, or PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience).
  • 15+ years of hands-on experience developing deep learning–based perception or related systems, taking models from prototype to production.
  • Strong proficiency in deep learning frameworks such as PyTorch.
  • Demonstrated technical leadership as a senior or principal-level individual contributor owning features or subsystems end-to-end.
  • Proven experience in data-driven development, collaborating with data, labeling, and ground-truth teams on data strategy and model improvement.
  • Strong programming skills in Python and/or C++ for building reliable, high-performance, production-quality software.

Skills: autonomous driving, 3D obstacle perception, deep learning models, multi-sensor fusion, transformer-based

More semiconductor jobs: NVIDIA jobs · AI chip design jobs

Market context

Tracked in our index since 6 Jul 2026. This is our observation date, not the employer posting date. Specialty: AI/ML Hardware Engineering (AI ML Hardware). 472 active roles in this specialty at 76 employers in our index, as of 22 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Santa Clara, CA, United States
On-site
$272,000 - $431,250 USD yearly
5 months ago

Share this job