Engineering Manager, Compiler & Runtime
Build and lead the team delivering compiler, runtime, and kernel software for PyTorch execution on pre-silicon architectures.
Originally posted October 23, 2026 by the employer.
About the role
As Engineering Manager, Compiler & Runtime, you will build and lead the team writing the compiler, runtime, and kernels that take PyTorch models to hardware designed for in-memory large-model inference. The team builds against simulators and FPGA prototypes ahead of silicon bring-up.
What you'll do
- Grow the compiler and runtime team from its first engineers, set the hiring bar, and develop each engineer's growth and career.
- Turn the Systems Software roadmap into plans, milestones, and staffing for the compiler, runtime, and kernels, targeting end-to-end execution of LLMs from PyTorch.
- Work with the compiler architect to make, staff, and execute technical decisions while reviewing designs and evaluating trade-offs.
- Coordinate with the hardware team across drivers and firmware, as well as serving and simulation dependencies.
- Maintain compiler and runtime compatibility across simulators, FPGA prototypes, and silicon throughout hardware maturation.
- Establish testing, release, and review practices to produce a production-ready software stack.
What you'll need
- Experience managing engineers who build compilers, runtimes, or kernels for accelerators or non-standard hardware.
- Track record of hiring and mentoring systems engineers.
- Technical depth in compilers and runtimes to review designs and evaluate trade-offs with senior engineers.
- Experience delivering software against a hardware schedule, from simulation through bring-up.
- Familiarity with ML compiler stacks and LLM inference workloads.
Nice to have
- Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative.
- Experience with in-memory compute, processing-in-memory, or analog hardware interfaces.
- Experience shipping an SDK or software product to external customers.
More semiconductor jobs: Normal Computing jobs · Embedded software jobs · Mountain View jobs
Tracked in our index since 24 Oct 2026. This is our observation date, not the employer posting date. Specialty: Systems Software Engineering (Systems Software). 720 active roles in this specialty at 79 employers in our index, as of 20 Nov 2026.
How we counted: postings read from employer career sites. How we count