Sr Staff Engineer
$220,800 USD yearly
Originally posted 16 September 2026 by the employer.
About the role
As a Sr Staff Engineer at Lattice Semiconductor, you will architect enterprise-wide Generative AI solutions and lead the design, implementation, and governance of an enterprise AI gateway.
What you'll do
- Design and architect enterprise-wide Generative AI solutions, including reference architectures, integration patterns, and technical standards.
- Design, build, and maintain an enterprise AI gateway to centralize access, governance, and monitoring of AI model consumption across the organization.
- Develop and implement intelligent routing techniques to direct requests across multiple LLMs and AI providers based on cost, latency, accuracy, and availability requirements.
- Evaluate and integrate local and on-premises models as alternatives to third-party hosted models to reduce operational costs.
- Define best practices for prompt orchestration, caching strategies, and fallback mechanisms within the AI gateway.
- Provide mentorship and technical leadership to AI/ML engineers and teams adopting Generative AI capabilities.
What you'll need
- Master's or Ph.D. in Computer Science, AI, Machine Learning, or a related field.
- 5+ years of experience in AI and machine learning, with at least 2 years of experience working on LLMs, code generation, RAG, or AI-powered automation.
- Demonstrated experience architecting Generative AI solutions at an enterprise scale, including hands-on experience designing and implementing AI gateway solutions and model routing techniques.
- Experience deploying models on-prem or at the edge using frameworks such as PyTorch, TensorRT, ONNX, vLLM, or llama.cpp.
- Experience optimizing models for local inference through quantization, pruning, and distillation.
- Experience building and deploying scalable AI models and retrieval pipelines using cloud-based MLOps pipelines (AWS/GCP/Azure, Docker, Kubernetes).
- Practical experience with agentic AI systems, APIs (such as LangChain, OpenAI APIs), and fine-tuning LLMs (GPT, Llama, Mistral, Claude, Gemini).
Skills: LLMs, PyTorch, TensorRT, quantization, inference pipelines, edge deployment
More semiconductor jobs: San Jose jobs
This role has been open 42 days — well below the 68-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · AI ML Hardware
|
Open roles in category
112
|
Median days open
68 d
|
Category median salary (all employers)
$206k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Lattice Semiconductor | All employers we track in this specialty (112 roles · 29 employers) |
|---|---|---|
| Open roles in this specialty | 1 | 112 |
| Open roles in the wider Software, Firmware & Systems family | 46 | 6295 · 144 employers |
| Median days open | 42 d | 68 d (−26 d vs this employer) |
| Median salary (USD postings) | — | $206k |
Skills observed across this category: LLMs, PyTorch, TensorRT, quantization, inference pipelines, edge deployment
Who's hiring in this category
- Qualcomm · 23 open roles · median 52 d
- NVIDIA · 18 open roles · median 65 d
- Graphcore · 8 open roles · median 125 d
- Intel Corporation · 8 open roles · median 20 d
- AMD · 7 open roles · median 37 d
- Micron Technology · 6 open roles · median 52 d
How we counted: 112 open Infrastructure/Platform Software (AI ML Hardware) roles from 29 employers tracked in the SemiconductorJobs index, counted 29 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.