System Software Engineer - AI - Montreal, Canada
$120,000 - $180,000 USD yearly
Originally posted 4 May 2026 by the employer. Relisted by the employer on 15 October 2026.
About the role
As a System Software Engineer - AI, you will bridge the gap between high-level AI frameworks and low-level system software. You will design and implement the communication and execution primitives that allow large-scale AI models to run across thousands of GPUs.
What you'll do
- Collaborate across the stack to influence the design of foundational technology for AI models. - Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface. - Conduct rigorous performance benchmarking and characterization on multi-node clusters.
What you'll need
- Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals including memory management, concurrency, and OS internals. - Proficiency in a Linux development environment. - Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.
Nice to have
- Experience with GPU programming (CUDA) and performance optimization for parallel architectures. - Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) or inference engines (vLLM, SGLang, Dynamo/TRT-LLM). - Hands-on experience with large-scale cluster orchestration and telemetry tools.
Skills: infrastructure layer, distributed training, GPU programming, AI frameworks, C++/Python
This role has been open 96 days — well above the 54-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
1009
|
Median days open
54 d
|
Median salary
$223k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Delos Data | All employers we track in this specialty (1009 roles · 91 employers) |
|---|---|---|
| Open roles in this specialty | 5 | 1009 |
| Open roles in the wider Software, Firmware & Systems family | 6 | 6292 · 146 employers |
| Median days open | 57 d | 54 d (+3 d vs this employer) |
| Median salary (USD postings) | — | $223k |
Skills observed across this category: infrastructure layer, distributed training, GPU programming, AI frameworks, C++/Python
Who's hiring in this category
- NVIDIA · 282 open roles · median 53 d
- Qualcomm · 65 open roles · median 54 d
- AMD · 57 open roles · median 28 d
- Intel Corporation · 49 open roles · median 13 d
- Graphcore · 48 open roles · median 102 d
- Cerebras · 35 open roles · median 92 d
How we counted: 1009 open Infrastructure/Platform Software (Infrastructure Platform) roles from 91 employers tracked in the SemiconductorJobs index, counted 27 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.