AI Engineer, Model Quality and Performance - Sunnyvale, CA, United States
Originally posted 15 May 2026 by the employer.
This role focuses on model quality and performance for Cerebras' inference offerings.
About the role
This role involves owning model quality and performance for Cerebras' inference offerings, defining standards, and building AI-driven systems to measure it at scale.
What you'll do
- Design eval suites with AI agents, curating a mix of advanced, basic, long-context, and customer-use-case-specific evaluations. - Build custom evaluations for target customers by orchestrating AI agents to mine trajectories from workloads and synthesize representative eval sets. - Automate eval execution end-to-end with AI-driven pipelines using Docker, Git, and CI. - Build automations to forecast and benchmark model performance on Cerebras for top customers. - Build tooling that synthesizes quality and performance data into a single, easy-to-use view.
What you'll need
- Experience building AI agents and shipping real systems with Claude (or equivalent). - Strong math/stats background. - Comfort with Docker, Git, and the standard automation stack. - A taste for tooling design, having shipped something a non-engineer used without complaining.
Nice to have
- Performance-tuning experience on custom silicon, GPUs, or FPGAs. - Experience designing evals for agentic / coding / long-context / multimodal use cases. - Familiarity with open-source eval frameworks (EvalScope, lm-eval-harness, etc.).
Skills: model quality, performance optimization, AI agents, eval suites, benchmarking workflows
This role has been open 84 days — well above the 55-day median for Software Engineering Semiconductor roles.
Software Engineering Semiconductor · AI ML Hardware
|
Open roles in category
160
|
Median days open
55 d
|
Median salary
$184k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Cerebras | All employers we track in this specialty (160 roles · 43 employers) |
|---|---|---|
| Open roles in this specialty | 2 | 160 |
| Open roles in the wider Software, Firmware & Systems family | 73 | 6118 · 145 employers |
| Median days open | 84 d | 55 d (+29 d vs this employer) |
| Median salary (USD postings) | — | $184k |
Skills observed across this category: model quality, performance optimization, AI agents, eval suites, benchmarking workflows
Who's hiring in this category
- Micron Technology · 27 open roles · median 33 d
- NVIDIA · 25 open roles · median 217 d
- Qualcomm · 22 open roles · median 193 d
- Infineon Technologies · 11 open roles · median 45 d
- AMD · 8 open roles · median 55 d
- Applied Materials · 4 open roles · median 89 d
How we counted: 160 open Software Engineering Semiconductor (AI ML Hardware) roles from 43 employers tracked in the SemiconductorJobs index, counted 19 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.