$170,900 - $231,200 USD yearly
Originally posted October 26, 2026 by the employer.
About the role
Arm is hiring a Staff AI Engineer to design and build open-source foundations, SDKs, and developer tools for Physical AI systems operating across cloud and edge environments. You will work on platform software that lets AI applications and agents interact with physical devices, coordinate workflows, and deploy across heterogeneous hardware.
What you'll do
- Design and implement features in SDKs and reference services across both the device side and the agent side.
- Build reference applications and demos connecting agents to physical devices across edge and cloud using PyTorch-ecosystem inference runtimes and agent frameworks.
- Develop evaluation harnesses to measure the reliability, latency, and correctness of agent-to-device interactions.
- Bring up and maintain a fleet of development hardware including single-board computers, cameras, sensors, robot platforms, and edge servers.
- Contribute to platform identity, authorization, observability, and safe failure behavior.
- Author technical documentation, code samples, and learning materials for external developers, while supporting the open-source community through issues and code reviews.
What you'll need
- Professional software engineering experience building distributed systems, with strong Python and working proficiency in at least one of C++, Rust, or Go.
- Experience building and shipping AI-powered applications, including LLM tool use or agent frameworks, and integrating them with real systems.
- Practical experience deploying ML models for inference on servers or on edge devices using PyTorch or a comparable framework.
- Grounding in messaging, RPC, concurrency, failure handling, and testing of networked software.
- Hands-on experience with Linux, embedded single-board computers, containers, and CI/CD workflows.
- Degree or equivalent experience in Computer Science, Electrical Engineering, Robotics, or a related field.
Nice to have
- Experience with publish/subscribe messaging systems or IoT protocols.
- Familiarity with the Model Context Protocol or similar agent-tool interfaces.
- Robotics or physical-AI background including ROS 2, robot arms, perception pipelines, or control loops.
- On-device inference experience with ExecuTorch, ONNX Runtime, or vendor NPU toolchains, and LLM serving with vLLM or similar.
- Experience designing evaluations or benchmarks for AI agents.
- Contributions to open-source projects and experience supporting an external developer community.
- Security fundamentals for connected devices.
Skills: SDK, PyTorch, Edge computing, Inference runtimes, Python
More semiconductor jobs: Arm Holdings jobs
Tracked in our index since 29 Oct 2026. This is our observation date, not the employer posting date. Specialty: Infrastructure/Platform Software (Infrastructure Platform). 1067 active roles in this specialty at 97 employers in our index, as of 20 Nov 2026.
How we counted: postings read from employer career sites. How we count