[Japan] Compiler Software Engineer - Remote
Extend deep learning compilers and software toolchains targeting custom AI hardware accelerators using MLIR and LLVM.
About the role
In this role, working closely with hardware and ML engineers, you will extend the compiler and software toolchain for deploying machine learning models with high performance and flexibility on proprietary AI hardware accelerators.
What you'll do
- Extend compiler and software toolchain components for deep learning model deployment on edge AI hardware. - Implement and optimize ML graph optimization passes and compilation pipelines. - Integrate software using MLIR and LLVM frameworks to support neural network execution on custom hardware architectures. - Collaborate with hardware and ML engineering teams across development cycles.
What you'll need
- Bachelor's degree in Computer Engineering, Computer Science, and/or Electrical Engineering. - 5+ years of Software Engineering experience. - 3+ years experience writing production-quality C++. - 2+ years experience developing Python, including pip packaging and C++ bindings. - 2+ years experience on ML graph optimization passes. - 1+ years experience using the MLIR/LLVM framework. - Experience with code management using Git and familiarity with GitHub/GitLab PR flows, plus exposure to CI/CD tools such as Jenkins. - Knowledge of ML quantization techniques and mixed precision inference. - Strong debugging and analysis skills for root-causing complex issues.
Nice to have
- Knowledge of neural networks, with hands-on experience using ML frameworks such as TensorFlow, PyTorch, or ONNX. - Knowledge of Convolutional Neural Networks (CNNs), RNN/LSTMs, or Transformers (LLMs) and familiarity with multi-modal ML models. - Experience developing embedded software, preferably for ASIC or on-device ML. - Experience with low-level machine-specific code generation (e.g. x86, RISC-V, or similar) or microcode generation. - Experience with vectorization and parallel programming models such as OpenMP or CUDA/OpenCL. - Experience writing performance or functional simulators, and interpreters. - Previous experience working in an Agile environment across different time zones.
Skills: compiler, software toolchain, MLIR/LLVM, ML graph optimization, C++/Python
This role has been open 124 days — well above the 67-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · AI ML Hardware
|
Open roles in category
106
|
Median days open
67 d
|
Median salary
$216k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | EdgeCortix | All employers we track in this specialty (106 roles · 28 employers) |
|---|---|---|
| Open roles in this specialty | 1 | 106 |
| Open roles in the wider Software, Firmware & Systems family | 4 | 6292 · 146 employers |
| Median days open | 124 d | 67 d (+57 d vs this employer) |
| Median salary (USD postings) | — | $216k |
Skills observed across this category: compiler, software toolchain, MLIR/LLVM, ML graph optimization, C++/Python
Who's hiring in this category
- Qualcomm · 25 open roles · median 57 d
- NVIDIA · 18 open roles · median 63 d
- Graphcore · 8 open roles · median 123 d
- AMD · 6 open roles · median 46 d
- Intel Corporation · 6 open roles · median 18 d
- Micron Technology · 6 open roles · median 50 d
How we counted: 106 open Infrastructure/Platform Software (AI ML Hardware) roles from 28 employers tracked in the SemiconductorJobs index, counted 27 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.