AI Fleet Platform Software Engineer - Sunnyvale, CA, United States
Originally posted 2 October 2026 by the employer.
About the role
This role is for a senior software engineer to build the platforms and tools for monitoring and managing large fleets of AI clusters. You will own substantial engineering work across backend services, operational tools, and user-facing applications for AI clusters.
What you'll do
- Build and operate software for managing large fleets of AI clusters.
- Give operators clear, actionable views of cluster health, capacity, performance, and ongoing issues.
- Develop services and integrations that bring together data and workflows from multiple infrastructure systems.
- Automate repetitive work and improve the tools teams use to investigate incidents and restore service.
- Design systems that remain reliable as the fleet grows and continue to function through component and site failures.
- Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.
What you'll need
- 12+ years of industry experience building and operating production distributed systems or large-scale infrastructure software.
- Strong Go skills, with experience using Protocol Buffers and SQL regularly. Python experience is an added benefit.
- Experience building control planes, fleet management systems, or operational platforms.
- Experience designing APIs and data models that serve multiple consumers, with a considered approach to versioning and compatibility.
- Experience building asynchronous systems that support idempotency, concurrency, and reconciliation while preventing unintended state drift.
- A strong testing practice for software that can change the state of running production clusters.
- Experience with Linux, containers, and Kubernetes.
- Experience with durable workflow execution, event streaming, or time-series telemetry at high cardinality.
- Sound judgment about reliability, security, and observability, including how a system behaves when its dependencies are unavailable.
- Ability to take an ambiguous problem from design through production and improve the solution using operational feedback.
Nice to have
- Building infrastructure software for thousands of hosts across multiple sites.
- Developing software for incident response, hardware health, or capacity management.
- Deploying and operating services on AWS.
- Working with AI or HPC clusters and their compute, networking, and hardware systems.
- Developing dashboards or applications for infrastructure operators.
Skills: fleet management, distributed systems, Kubernetes, Go, Python, AI clusters
This role has been open 7 days — well below the 51-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
912
|
Median days open
51 d
|
Median salary
$229k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Cerebras | All employers we track in this specialty (912 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 39 | 912 |
| Open roles in the wider Software, Firmware & Systems family | 77 | 6078 · 146 employers |
| Median days open | 75 d | 51 d (+24 d vs this employer) |
| Median salary (USD postings) | — | $229k |
Skills observed across this category: fleet management, distributed systems, Kubernetes, Go, Python, AI clusters
Who's hiring in this category
- NVIDIA · 250 open roles · median 49 d
- Qualcomm · 60 open roles · median 61 d
- AMD · 51 open roles · median 28 d
- Cerebras (this employer) · 40 open roles · median 74 d
- Graphcore · 38 open roles · median 101 d
- Intel Corporation · 33 open roles · median 21 d
How we counted: 912 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 9 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.