Director Site Reliability Engineer, AI Infrastructure - Santa Clara, United States
Originally posted 26 September 2026 by the employer.
About the role
This role builds and leads d-Matrix's Site Reliability Engineering function from the ground up, owning the infrastructure that development, validation, and customer-facing deployments run on. The infrastructure spans colocation facilities, on-premises lab clusters, cloud environments (AWS, Azure, GCP), and customer-facing platform services for purpose-built AI inference silicon.
What you'll do
- Build and lead the SRE function, define its charter, and establish SRE as a discipline across hardware and software engineering.
- Own 24x7 reliability across colocation, on-premises lab clusters, cloud, and customer-facing platform services.
- Establish SRE process from zero, including SLIs/SLOs, error budgets, on-call rotations, and incident/RCA management framework.
- Own the full observability stack (Prometheus, Grafana, Datadog, Splunk or equivalent), instrumenting metrics, traces, and logs for SLO visibility and alert design.
- Drive IaC-first automation (Terraform, Ansible) and build self-healing infrastructure.
- Own FinOps and capacity planning across cloud, colocation, and on-premises tiers.
What you'll need
- Bachelor's or Master's in Computer Science, Electrical Engineering, or a related field; 15+ years in SRE, infrastructure engineering, or production engineering.
- 5+ years leading SRE or infrastructure engineering teams, with experience building or rebuilding a function.
- Demonstrated track record of establishing SRE as a discipline: defining SLOs, creating on-call frameworks, and standing up observability.
- Deep Linux systems expertise: bare-metal operations, enterprise shared storage platforms (NAS/SAN, NFS/SMB at scale, snapshot and replication architectures), and hybrid-cloud storage integration.
- Proven experience operating colocation and on-premises hardware at scale: server lifecycle, power and cooling awareness, rack-level networking.
- Hands-on Infrastructure as Code fluency with Terraform and Ansible at production scale.
- Kubernetes cluster operations: lifecycle management, workload reliability, storage, and RBAC at scale.
- Full observability stack ownership (Prometheus, Grafana, Datadog and/or Splunk or equivalent) for SLO definition, alert design, and end-to-end signal quality.
- Strong Python and/or Go scripting for production services and automation.
- Executive communication skills, translating infrastructure health and operational risk into clear narratives.
Nice to have
- Experience operating customer-facing infrastructure or platform services.
- Knowledge of high-speed interconnect fabrics (InfiniBand, RoCE, or NVLink).
- HPC job scheduler experience (Slurm, LSF, or equivalent).
- Multi-cloud hybrid operations across AWS, Azure, and GCP with unified observability and IaC.
- FinOps expertise: cloud spend attribution, TCO modeling across cloud vs. on-prem vs. colo.
- ITIL knowledge or an equivalent structured incident/problem/change management framework.
- Published technical writing, conference talks, or open-source contributions in reliability, observability, or HPC infrastructure.
Skills: SRE, Kubernetes, Terraform, Linux systems, observability stack, Python
This role has been open 0 days — well below the 50-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
845
|
Median days open
50 d
|
Median salary
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | d-Matrix | All employers we track in this specialty (845 roles · 85 employers) |
|---|---|---|
| Open roles in this specialty | 6 | 845 |
| Open roles in the wider Software, Firmware & Systems family | 18 | 5833 · 143 employers |
| Median days open | 102 d | 50 d (+52 d vs this employer) |
| Median salary (USD postings) | — | $236k |
Skills observed across this category: SRE, Kubernetes, Terraform, Linux systems, observability stack, Python
Who's hiring in this category
- NVIDIA · 234 open roles · median 39 d
- Qualcomm · 54 open roles · median 63 d
- AMD · 40 open roles · median 24 d
- Cerebras · 38 open roles · median 62 d
- Graphcore · 36 open roles · median 92 d
- Micron Technology · 31 open roles · median 48 d
How we counted: 845 open Infrastructure/Platform Software (Infrastructure Platform) roles from 85 employers tracked in the SemiconductorJobs index, counted 27 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.