Embedded AI Tools Engineer - MA, Wilmington, United States
$121,600 - $167,200 USD yearly
Originally posted 8 October 2026 by the employer.
About the role
This role involves designing and implementing embedded AI deployment infrastructure and model optimization tools for SoCs. You will contribute to enabling embedded system engineers and research scientists to deliver AI-based solutions using ADI hardware.
What you'll do
- Design, test, implement, and release AI model deployment tools and infrastructure for heterogeneous computer architectures (DSPs, NPUs, CPUs).
- Build end-to-end workflows spanning model development, optimization, hardware-specific architecture, and deployment to embedded platforms.
- Develop tools and infrastructure for hardware-aware model design, including architecture mapping techniques.
- Design and implement model compilation and optimization pipelines for quantization, pruning, layer fusion, and hardware-specific code generation.
- Explore and prototype agentic AI workflows for automated model-hardware co-optimization and adaptive deployment strategies.
What you'll need
- Strong embedded systems and computer architecture experience (bare-metal, RTOS, or embedded Linux).
- Expertise in end-to-end AI/ML model development, from training through optimization and deployment on embedded platforms.
- Experience with hardware-aware neural architecture design and model optimization techniques tailored to specific processor architectures.
- Proficiency in C, C++, Python, with experience in firmware and low-level software development.
- Deep understanding of neural network quantization, pruning, knowledge distillation, and optimization techniques for resource-constrained devices.
- Knowledge of neural network accelerators (NPUs, DSPs) and efficient execution of neural networks on heterogeneous hardware.
- Familiarity with AI/ML frameworks (TensorFlow, PyTorch) and deployment tools (TensorFlow Lite, ONNX Runtime, TVM, etc.).
- Experience with build systems (CMake, Make, Ninja), CI/CD pipelines, and infrastructure automation.
Nice to have
- Experience with hardware-software co-design and custom operator development for specialized hardware.
- Knowledge of neural architecture search (NAS) and automated model optimization techniques.
- Background in digital signal processing (DSP) and algorithm implementation experience.
- Experience with edge AI frameworks and deployment tools (TensorFlow Lite Micro, ONNX, Apache TVM, MLIR).
- Understanding of compiler optimizations and code generation for embedded AI accelerators.
- Experience with FPGA development including design, synthesis, simulation, and verification.
- Experience with Zephyr RTOS and open-source RTOS ecosystems.
- Understanding of heterogeneous architectures (ARM, RISC-V, DSPs, custom SoCs).
Skills: Embedded AI, model optimization, heterogeneous computer architectures, DSP, NPU
This role has been open 2 days — well below the 76-day median for AI/ML Hardware Engineering roles.
AI/ML Hardware Engineering · AI ML Hardware
|
Open roles in category
512
|
Median days open
76 d
|
Median salary
$235k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Analog Devices | All employers we track in this specialty (512 roles · 76 employers) |
|---|---|---|
| Open roles in this specialty | 17 | 512 |
| Open roles in the wider Software, Firmware & Systems family | 107 | 6025 · 146 employers |
| Median days open | 29 d | 76 d (−47 d vs this employer) |
| Median salary (USD postings) | — | $235k |
Skills observed across this category: Embedded AI, model optimization, heterogeneous computer architectures, DSP, NPU
Who's hiring in this category
- Qualcomm · 98 open roles · median 115 d
- NVIDIA · 89 open roles · median 54 d
- AMD · 41 open roles · median 67 d
- Micron Technology · 28 open roles · median 66 d
- Mobileye · 19 open roles · median 73 d
- Analog Devices (this employer) · 17 open roles · median 29 d
How we counted: 512 open AI/ML Hardware Engineering (AI ML Hardware) roles from 76 employers tracked in the SemiconductorJobs index, counted 11 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.