Originally posted 8 May 2026 by the employer.
This role focuses on building and maintaining scalable AI inference services.
About the role
This role involves designing and developing software features that support system resiliency and high availability across distributed environments, specifically for scalable AI inference services.
What you'll do
- Design and develop software features for system resiliency and high availability, including automated recovery mechanisms and fault-tolerant architecture across distributed environments.
- Develop and maintain cloud-based deployment workflows for AI inference software using AWS tools and services.
- Develop Python-based scripts and APIs to streamline data preprocessing, inference execution, and post-processing for real-time inference tasks.
- Use parallel programming techniques (e.g., multi-threading, asynchronous processing) to maximize resource efficiency on AWS compute instances.
- Develop inference software in Docker containers and define Kubernetes orchestration strategies for reliability and efficient scaling.
- Debug issues related to model deployment, container orchestration, and networking configurations, documenting steps to reproduce and root-cause defects.
What you'll need
- Master's degree or foreign equivalent degree in Computer Science, or a related field.
- 18 months of experience as an Information Security Analyst, Software Engineer, Sr. Member of Technical Staff, IT Senior Applications Engineer, or a related occupation.
- Infrastructure-as-Code and deployment automation: Terraform, AWS CloudFormation, AWS CDK, and Ansible.
- Containerization and orchestration: Docker, Kubernetes, AWS EKS, AWS Elastic Container Service (ECS), AWS Fargate, and Helm.
- Compute and serverless services: AWS EC2, AWS Lambda functions, and Auto Scaling Groups.
- Monitoring, logging, and distributed tracing: AWS CloudWatch, AWS X-Ray, ELK (Elasticsearch, Logstash, Kibana), Prometheus, and Grafana.
- Programming languages and frameworks: Python, Node.js, JavaScript, and Flask.
- Data storage and caching: PostgreSQL, Redis, and NFS.
- CI/CD and version control: Jenkins and Git.
Skills: distributed environments, cloud-based deployment, AWS, Docker, Kubernetes
This role has been open 84 days — well above the 52-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
968
|
Median days open
52 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Cerebras | All employers we track in this specialty (968 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 36 | 968 |
| Open roles in the wider Software, Firmware & Systems family | 73 | 6118 · 145 employers |
| Median days open | 84 d | 52 d (+32 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: distributed environments, cloud-based deployment, AWS, Docker, Kubernetes
Who's hiring in this category
- NVIDIA · 278 open roles · median 47 d
- Qualcomm · 62 open roles · median 54 d
- AMD · 54 open roles · median 20 d
- Graphcore · 44 open roles · median 94 d
- Intel Corporation · 43 open roles · median 13 d
- Cerebras (this employer) · 36 open roles · median 84 d
How we counted: 968 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 19 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.