$149,100 - $238,200 USD yearly
Co-design agentic AI architectures, RAG pipelines, and LLM inference optimization for FPGA and ASIC platforms.
Originally posted November 16, 2026 by the employer.
About the role
Lead the design and development of agentic AI systems integrated with FPGA/ASIC platforms. The role sits at the intersection of large language models, agent frameworks, retrieval-augmented generation (RAG), and hardware-aware AI system design across FPGA, ASIC, and EDA platforms.
What you'll do
- Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration from data ingestion to reasoning and action.
- Architect enterprise-scale RAG pipelines and vector databases for knowledge integration.
- Develop workflows utilizing tool-using agents, planning and reasoning agents, and multi-agent collaboration frameworks.
- Co-design AI systems with FPGA acceleration, ASIC platforms, and heterogeneous compute architectures (CPU/GPU/FPGA).
- Explore LLM inference optimization on FPGA through quantization, compilation, and partitioning.
- Build internal platforms using LangChain, LlamaIndex, and custom agent orchestration frameworks.
What you'll need
- Bachelor's or Master's degree with 10+ years of experience in AI/ML systems, distributed systems, or hardware-software co-design.
- Deep expertise in LLM architectures, inference, RAG systems, vector databases, and autonomous agentic AI.
- Hands-on experience building production-grade LLM applications and scalable multi-step reasoning workflows.
- Technical background in FPGA, ASIC, EDA systems, and heterogeneous computing architectures.
- Experience with hardware acceleration for AI workloads and cross-stack performance optimization.
- Proficiency in Python programming, distributed systems design, APIs, and microservices architecture.
Nice to have
- Proficiency in C++ programming.
- Hands-on experience with LLM fine-tuning, quantization, and model distillation.
- Experience with on-device or edge AI deployment, robotics, or real-time AI pipelines.
- Knowledge of compiler stacks (such as MLIR or TVM) and AI model optimization for FPGA platforms.
Skills: LLM, Agentic AI, FPGA, ASIC, RAG, hardware acceleration
More semiconductor jobs: Altera jobs · AI chip design jobs · San Jose jobs
First seen in our index 0 days ago, well below the 103-day median for AI/ML Hardware Engineering roles.
AI/ML Hardware Engineering · AI ML Hardware
|
Open roles in category
486
|
Median days since first seen
103 d
|
Category median salary (all employers)
$236k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Altera | All employers we track in this specialty (486 roles · 77 employers) |
|---|---|---|
| Open roles in this specialty | 5 | 486 |
| Open roles in the wider Software, Firmware & Systems family | 17 | 6857 · 180 employers |
| Median days since first seen | 39 d | 103 d (+64 d vs this employer) |
| Median salary (USD postings) | n/a | $236k |
Skills observed across this category: LLM, Agentic AI, FPGA, ASIC, RAG, hardware acceleration
Who's hiring in this category
- NVIDIA · 109 open roles · median 90 d
- Qualcomm · 104 open roles · median 125 d
- AMD · 21 open roles · median 130 d
- Micron Technology · 15 open roles · median 74 d
- Mobileye · 15 open roles · median 104 d
- Analog Devices · 14 open roles · median 53 d
How we counted: 486 open AI/ML Hardware Engineering (AI ML Hardware) roles from 77 employers tracked in the SemiconductorJobs index, counted 16 Nov 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there, and is counted in the wider Software, Firmware & Systems family row. Days are counted from when our index first saw each posting, not from the employer's original posting date.