Originally posted 27 October 2026 by the employer.
Arm Neoverse
About the role
As a Staff Software Engineer on the Agentic AI Compute team, you will build the compute platform for distributed AI workflows across the full software stack. Your work ensures AI developments take full advantage of Arm Neoverse platforms and cloud-server technologies like AGI-CPU.
What you'll do
- Build and optimize software across the full stack, spanning applications, frameworks, compilers, libraries, and assembly.
- Orchestrate models, data, tools, and services across complex, distributed workflows on Arm architectures.
- Profile, debug, and analyze performance across unfamiliar codebases and system runtimes down to the underlying hardware.
- Lead the delivery of technical software projects involving multiple contributors.
- Collaborate with open-source communities and partner engineering teams to deploy AI software on Arm.
What you'll need
- Programming proficiency in C++ and Python.
- Practical experience with Linux development environments, profiling, debugging, and performance analysis.
- Understanding of end-to-end application and system performance, from high-level runtimes to hardware execution.
- Track record of delivering complex technical projects involving multiple contributors.
- Degree in a computational or numerate subject, or equivalent experience.
Nice to have
- Experience with ML frameworks and LLM inference, including PyTorch, vLLM, SGLang, or llama.cpp.
- Experience analyzing and optimizing CPU performance in heterogeneous CPU + accelerator systems.
- Familiarity with agentic AI frameworks, protocols, and CPU bottlenecks in agentic workloads.
- Understanding of databases, vector search, retrieval systems, containers, and cloud/server infrastructure.
- Familiarity with batching, scheduling, KV-cache management, collective communications, and distributed AI workloads.
- Experience optimizing software for AArch64/Arm servers, including SIMD technologies such as Neon, SVE, and SME.
- Experience contributing to large open-source software projects.
Skills: C++, Python, agentic AI, Linux, performance optimization
This role has been open 1 day — well below the 50-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1033
|
Median days open
50 d
|
Median salary
$232k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Arm Holdings | All employers we track in this specialty (1033 roles · 91 employers) |
|---|---|---|
| Open roles in this specialty | 34 | 1033 |
| Open roles in the wider Software, Firmware & Systems family | 130 | 6367 · 147 employers |
| Median days open | 1 d | 50 d (−49 d vs this employer) |
| Median salary (USD postings) | — | $232k |
Skills observed across this category: C++, Python, agentic AI, Linux, performance optimization
Who's hiring in this category
- NVIDIA · 295 open roles · median 51 d
- Qualcomm · 59 open roles · median 56 d
- AMD · 53 open roles · median 30 d
- Graphcore · 48 open roles · median 104 d
- Intel Corporation · 46 open roles · median 14 d
- Cerebras · 36 open roles · median 93 d
How we counted: 1033 open Infrastructure/Platform Software (Infrastructure Platform) roles from 91 employers tracked in the SemiconductorJobs index, counted 29 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.