$262,700 - $355,400 USD yearly
Originally posted September 9, 2026 by the employer.
About the role
As a Principal Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference across Arm's AI workloads.
What you'll do
- Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
- Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
- Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
- Improve platform scalability, observability, reliability, and developer workflows.
- Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.
What you'll need
- 12+ years of experience building distributed systems, cloud platforms, or production backend services.
- Experience with distributed ML training or inference systems.
- Strong programming skills in Go, Python, or similar systems languages.
- Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
- Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
Nice to have
- Experience with Kubernetes operators, schedulers, resource management, or GitOps.
- Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana.
- Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM.
- Experience delivering developer tools or platform capabilities from early build through production.
- Technical leadership, mentoring experience, or an advanced degree in a related field.
Skills: Kubernetes, distributed systems, Go, AI platform, inference serving
More semiconductor jobs: Arm Holdings jobs
Tracked in our index since 29 Oct 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (Infrastructure Platform). 1064 active roles in this specialty at 97 employers in our index, as of 21 Nov 2026.
How we counted: postings read from employer career sites. How we count