$209,100 - $282,900 USD yearly
Originally posted September 9, 2026 by the employer.
About the role
As a software engineer on the AI Compute Platform team, you will design and build a secure, reliable platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference.
What you'll do
- Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
- Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
- Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
- Improve platform scalability, observability, reliability, and developer workflows.
- Partner across teams to deliver distributed training, evaluation, and inference capabilities.
What you'll need
- 8+ years of experience building distributed systems, cloud platforms, or production backend services.
- Experience with distributed ML training or inference systems.
- Strong programming skills in Go, Python, or similar systems languages.
- Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
- Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
Nice to have
- Experience with Kubernetes operators, schedulers, resource management, or GitOps.
- Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana.
- Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM.
- Experience delivering developer tools or platform capabilities from early build through production.
- Technical leadership, mentoring experience, or an advanced degree in a related field.
Skills: Kubernetes, distributed systems, Go, Python, APIs
More semiconductor jobs: Arm Holdings jobs
Tracked in our index since 29 Oct 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (Infrastructure Platform). 1064 active roles in this specialty at 97 employers in our index, as of 21 Nov 2026.
How we counted: postings read from employer career sites. How we count