Senior AI Platform Engineer - Austin, Texas, United States
$161,500 - $218,500 USD yearly
Originally posted 12 October 2026 by the employer.
Build and operate the Kubernetes and infrastructure-as-code foundation for Arm's central AI control plane and MCP server infrastructure.
About the role
This hands-on platform engineering role delivers and owns the production runtime platforms that support Arm's central AI control plane across internal engineering teams. You will work across Kubernetes, cloud, identity, networking, and telemetry to provide infrastructure for centrally hosted AI services including model gateway services and MCP server infrastructure.
What you'll do
- Build, operate, and continuously improve production infrastructure for AI platform services using custom and third-party solutions. - Own reliability, scalability, monitoring, alerting, incident response, runbooks, and operational readiness for AI platform components. - Develop automation for provisioning, deployment, configuration, backup, recovery, patching, upgrades, and lifecycle management using infrastructure-as-code and GitOps patterns. - Implement secure runtime patterns, including workload isolation, secrets management, identity integration, network controls, and auditability. - Define and implement service-level indicators, service-level objectives, alerting dashboards, and telemetry for AI platform health, usage, performance, and cost. - Participate in production support and a paid on-call rota for high-impact incident response.
What you'll need
- Familiarity with AI platform concepts such as model routing, MCP servers, agentic workflows, RAG systems, or LLM observability. - Strong experience deploying and operating production infrastructure or platform services in a Linux-based environment using Kubernetes, containers, cloud or private-cloud platforms, infrastructure-as-code, and CI/CD/GitOps tooling. - Strong automation and scripting skills, such as Terraform, Go, Python, or similar. - Experience with incident management, problem management, demand forecasting, and production readiness practices. - Strong understanding of security fundamentals for production platforms, including identity, secrets, access control, network segmentation, vulnerability management, and audit logging.
Nice to have
- Experience operating internal developer platforms, AI platforms, model gateways, MCP infrastructure, or other shared engineering platforms. - Experience with service mesh, policy-as-code, workload identity, sandboxing, secure runtime environments, or multi-tenant platform designs. - Experience with regulated or security-sensitive engineering environments. - Solid understanding of OpenAI tools, products, and APIs.
Skills: Kubernetes, platform engineering, infrastructure-as-code, Terraform, AI platform
This role has been open 0 days — well below the 55-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1016
|
Median days open
55 d
|
Median salary
$223k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Arm Holdings | All employers we track in this specialty (1016 roles · 91 employers) |
|---|---|---|
| Open roles in this specialty | 34 | 1016 |
| Open roles in the wider Software, Firmware & Systems family | 132 | 6391 · 148 employers |
| Median days open | 0 d | 55 d (−55 d vs this employer) |
| Median salary (USD postings) | — | $223k |
Skills observed across this category: Kubernetes, platform engineering, infrastructure-as-code, Terraform, AI platform
Who's hiring in this category
- NVIDIA · 286 open roles · median 52 d
- Qualcomm · 62 open roles · median 58 d
- AMD · 56 open roles · median 31 d
- Intel Corporation · 49 open roles · median 13 d
- Graphcore · 48 open roles · median 103 d
- Cerebras · 35 open roles · median 92 d
How we counted: 1016 open Infrastructure/Platform Software (Infrastructure Platform) roles from 91 employers tracked in the SemiconductorJobs index, counted 28 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.