Skip to main content
NVIDIA

Senior Software Engineer, Agentic AI

NVIDIA Santa Clara, CA, United States 2 months ago
Embedded & Systems Software

$184,000 - $356,500 USD yearly

Originally posted October 2, 2026 by the employer. Relisted by the employer on October 3, 2026.

About the role

NVIDIA is seeking a Senior Software Engineer to develop core libraries for Agentic Applications.

What you'll do

  • Track and evaluate evolving agent development patterns across NVIDIA and the broader ecosystem, covering research and commercial products.
  • Develop open-source libraries and tools to optimize agent harnesses and frameworks for performance, accuracy, quality, and stability.
  • Benchmark agents to identify bottlenecks and implement solutions to increase performance, reduce cost, and improve latency.
  • Collaborate with teams building high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows.
  • Identify friction in agent architectures and translate technical insights into agentic tools backed by evaluations, benchmarking, and feedback loops.

What you'll need

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
  • 8+ years experience in at least one of Rust, Python, Go, or Node.js, with working familiarity in at least one more.
  • Solid understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
  • Hands-on experience with evolving agent architectures, multiple agents frameworks, and agent harnesses.
  • Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
  • Experience designing or extending cross-language APIs with attention to consistency, usability, stability, and backwards compatibility.
  • Systems-level debugging and performance intuition to trace execution from high-level API calls through runtime internals, language bindings, callbacks, serialization, and event emission.

Nice to have

  • Experience building evaluation and benchmarking systems for agent workflows (metrics, regression, feedback loops).
  • Rust systems experience, especially async Rust, Tokio, serde, API design, or runtime state management, and/or Python native extension experience with PyO3, maturin, or Python/Rust bindings.
  • Experience instrumenting third-party frameworks without changing user-visible behavior, including knowledge of OpenTelemetry, tracing, structured events, exporters, or observability pipelines.
  • Experience with middleware, plugin systems, guardrails, policy engines, request/response interception, or maintaining open-source libraries, SDKs, or internal developer platforms.
  • Experience profiling or optimizing runtime and library overhead across language boundaries, async execution, native bindings, serialization, tracing, or middleware pipelines.

Skills: Agentic Applications, open-source libraries, AI and deep learning, Rust, Python, LLM applications

More semiconductor jobs: NVIDIA jobs

Market context

Tracked in our index since 7 May 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (Infrastructure Platform). 1067 active roles in this specialty at 97 employers in our index, as of 20 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Santa Clara, CA, United States
On-site
$184,000 - $356,500 USD yearly
2 months ago

Share this job