Skip to main content
Arm Holdings

Staff Software Engineer, AI Compute Platform

Arm Holdings Remote friendly (Seattle, Washington, United States) 2 months ago
Embedded & Systems Software

$209,100 - $282,900 USD yearly

Originally posted September 9, 2026 by the employer.

About the role

As a software engineer on the AI Compute Platform team, you will design and build a secure, reliable platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference.

What you'll do

  • Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
  • Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
  • Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
  • Improve platform scalability, observability, reliability, and developer workflows.
  • Partner across teams to deliver distributed training, evaluation, and inference capabilities.

What you'll need

  • 8+ years of experience building distributed systems, cloud platforms, or production backend services.
  • Experience with distributed ML training or inference systems.
  • Strong programming skills in Go, Python, or similar systems languages.
  • Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
  • Ability to build clear interfaces and simplify infrastructure for engineers and researchers.

Nice to have

  • Experience with Kubernetes operators, schedulers, resource management, or GitOps.
  • Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana.
  • Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM.
  • Experience delivering developer tools or platform capabilities from early build through production.
  • Technical leadership, mentoring experience, or an advanced degree in a related field.

Skills: Kubernetes, distributed systems, Go, Python, APIs

More semiconductor jobs: Arm Holdings jobs

Market context

Tracked in our index since 29 Oct 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (Infrastructure Platform). 1064 active roles in this specialty at 97 employers in our index, as of 21 Nov 2026.

How we counted: postings read from employer career sites. How we count

Apply now
Seattle, Washington, United States
Hybrid
$209,100 - $282,900 USD yearly
2 months ago

Share this job