Skip to main content
Ayo

AI Lead - Boston

Ayo Boston Full-time 5 months ago
AI/ML Hardware

Originally posted 12 May 2026 by the employer — open 132 days.

Prototype hardware for machine learning processors.

About the role

This role involves deep AI practice to deploy and train models on novel hardware, focusing on machine learning architectures and algorithm optimization.

What you'll do

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on chips.
  • Develop and adapt algorithms to train models on novel processing environments, including prototype hardware.
  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.
  • Maintain deep curiosity about what makes AI systems work and how they run on new hardware.
  • Support go-to-market strategy development.

What you'll need

  • PhD in machine learning, representation learning, theory of computation, or equivalent industry experience working on foundation models at scale.
  • Experience training models at scale, including distributed training across many GPUs, working with large datasets and compute.
  • Has built and trained neural networks from scratch.
  • Deep knowledge of the structure and internal operation of neural networks, including how and why they behave.
  • Fluent knowledge of Python.
  • Fluency in PyTorch, TensorFlow, JAX, or other industry-standard ML software libraries.

Skills: foundation model, distributed training, prototype hardware, neural networks, processor architecture

Market context

This role has been open 20 days — well below the 67-day median for AI/ML Hardware Engineering roles.

AI/ML Hardware Engineering · AI ML Hardware

Open roles in category
522
Median days open
67 d
Median salary
$235k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How Ayo compares in AI/ML Hardware Engineering hiring
Metric Ayo All employers we track in this specialty (522 roles · 76 employers)
Open roles in this specialty 2 522
Open roles in the wider Software, Firmware & Systems family 3 5873 · 143 employers
Median days open 20 d 67 d (−47 d vs this employer)
Median salary (USD postings) — $235k

Skills observed across this category: foundation model, distributed training, prototype hardware, neural networks, processor architecture

Who's hiring in this category

  • Qualcomm · 107 open roles · median 97 d
  • NVIDIA · 86 open roles · median 68 d
  • AMD · 46 open roles · median 60 d
  • Micron Technology · 32 open roles · median 40 d
  • Mobileye · 25 open roles · median 54 d
  • Analog Devices · 14 open roles · median 25 d

How we counted: 522 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 22 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.

Apply now
Boston
On-site
Full-time
5 months ago

Share this job