Software Engineer, Inference Platform - Sunnyvale, CA, United States
Originally posted 20 June 2026 by the employer.
This role primarily owns the orchestration layer that runs inference on our datacenter clusters.
About the role
This role is for a Software Engineer to contribute to projects on the Inference Platform team, which primarily owns the orchestration layer that runs inference on Cerebras datacenter clusters.
What you'll do
- Design, develop, test, and maintain production software across testing, continuous development, observability, security, networking, debugging, and productionization.
- Help shape the technical direction for the Inference Platform, Kubernetes custom resource definitions, failure domains, service boundaries, and system evolution.
- Architect active-active systems with rapid failover, graceful degradation, and clear SLOs; drive system-level improvements in latency, throughput, capacity efficiency, and resilience.
- Write and review production code in critical parts of the platform and make high-consequence architectural decisions.
- Lead on production issues and cross-system bottlenecks; drive observability, incident response, capacity planning, and post-incident improvement.
- Partner with ML, Product, Infrastructure, and Cloud teams to translate requirements into scalable system designs and drive alignment on shared technical decisions.
What you'll need
- 3+ years of experience in software engineering, with experience building and operating large-scale distributed systems or cloud infrastructure.
- Experience in distributed systems, ideally with Kubernetes.
- Experience building highly available, latency-sensitive systems at scale.
- Experience with security (certificates, TLS, mTLS).
- Experience optimizing latency, throughput, and efficiency in high-QPS systems.
- Strong proficiency in backend or systems languages such as Go or C++.
Nice to have
Skills: orchestration layer, datacenter clusters, Kubernetes operators, distributed systems, CI/CD
This role has been open 84 days — well above the 52-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
968
|
Median days open
52 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Cerebras | All employers we track in this specialty (968 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 36 | 968 |
| Open roles in the wider Software, Firmware & Systems family | 73 | 6118 · 145 employers |
| Median days open | 84 d | 52 d (+32 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: orchestration layer, datacenter clusters, Kubernetes operators, distributed systems, CI/CD
Who's hiring in this category
- NVIDIA · 278 open roles · median 47 d
- Qualcomm · 62 open roles · median 54 d
- AMD · 54 open roles · median 20 d
- Graphcore · 44 open roles · median 94 d
- Intel Corporation · 43 open roles · median 13 d
- Cerebras (this employer) · 36 open roles · median 84 d
How we counted: 968 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 19 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.