Skip to main content
Ayo

Machine Learning Architect - Boston

Ayo Boston Full-time 5 months ago
AI/ML Hardware

Originally posted 12 May 2026 by the employer — open 132 days.

About the role

This role focuses on deploying and training machine learning models on novel hardware processors specialized for machine learning.

What you'll do

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on chips.
  • Develop and adapt algorithms to train models on novel processing environments, including prototype hardware.
  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.
  • Maintain a deep curiosity about what makes machine learning systems work and how they run on new hardware.

What you'll need

  • PhD in machine learning, representation learning, theory of computation, or a related field, or equivalent industry experience working on foundation models at scale.
  • Experience training models at scale, including distributed training across many GPUs, working with large datasets and compute.
  • Built and trained neural networks from scratch.
  • Deep knowledge of the structure and internal operation of neural networks.
  • Fluent knowledge of Python.
  • Fluency in PyTorch, TensorFlow, JAX, or other industry-standard ML software libraries.

Skills: foundation model, distributed training, prototype hardware, neural networks, processor architecture

Market context

This role has been open 20 days — well below the 67-day median for AI/ML Hardware Engineering roles.

AI/ML Hardware Engineering · AI ML Hardware

Open roles in category
522
Median days open
67 d
Median salary
$235k
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
How Ayo compares in AI/ML Hardware Engineering hiring
Metric Ayo All employers we track in this specialty (522 roles · 76 employers)
Open roles in this specialty 2 522
Open roles in the wider Software, Firmware & Systems family 3 5873 · 143 employers
Median days open 20 d 67 d (−47 d vs this employer)
Median salary (USD postings) — $235k

Skills observed across this category: foundation model, distributed training, prototype hardware, neural networks, processor architecture

Who's hiring in this category

  • Qualcomm · 107 open roles · median 97 d
  • NVIDIA · 86 open roles · median 68 d
  • AMD · 46 open roles · median 60 d
  • Micron Technology · 32 open roles · median 40 d
  • Mobileye · 25 open roles · median 54 d
  • Analog Devices · 14 open roles · median 25 d

How we counted: 522 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 22 Sept 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.

Apply now
Boston
On-site
Full-time
5 months ago

Share this job