Skip to main content
NVIDIA

Senior Deep Learning Scientist, Multimodal Agentic RL - CA, Santa Clara, United States

NVIDIA Santa Clara, CA, United States 2 months ago
AI/ML Hardware

$184,000 - $287,500 USD yearly

Originally posted 2 October 2026 by the employer.

Define core algorithmic improvements for multimodal foundation models, scaling your ideas through Nemotron Omni and VoiceChat platforms.

About the role

This role is for a Senior Deep Learning Scientist to advance efforts in streaming and agentic multimodal AI. You will develop models capable of reasoning, planning, and acting across diverse modalities.

What you'll do

  • Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
  • Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
  • Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
  • Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.

What you'll need

  • Master’s degree or PhD in Computer Science, AI, or Applied Math with 5+ years of relevant work experience.
  • Excellent programming skills in Python with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
  • Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
  • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
  • Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction.
  • Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.

Skills: deep learning, multimodal AI, reinforcement learning, foundation models, agentic systems

Market context

This role has been open 5 days — well below the 75-day median for AI/ML Hardware Engineering roles.

AI/ML Hardware Engineering · AI ML Hardware

Open roles in category
521
Median days open
75 d
Median salary
$235k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How NVIDIA compares in AI/ML Hardware Engineering hiring
Metric NVIDIA All employers we track in this specialty (521 roles · 76 employers)
Open roles in this specialty 92 521
Open roles in the wider Software, Firmware & Systems family 964 6049 · 146 employers
Median days open 57 d 75 d (−18 d vs this employer)
Median salary (USD postings) — $235k

Skills observed across this category: deep learning, multimodal AI, reinforcement learning, foundation models, agentic systems

Who's hiring in this category

  • Qualcomm · 100 open roles · median 112 d
  • NVIDIA (this employer) · 89 open roles · median 51 d
  • AMD · 41 open roles · median 71 d
  • Micron Technology · 30 open roles · median 60 d
  • Mobileye · 19 open roles · median 70 d
  • Analog Devices · 16 open roles · median 33 d

How we counted: 521 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 8 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.

Apply now
Santa Clara, CA, United States
On-site
$184,000 - $287,500 USD yearly
2 months ago

Share this job