R&D Distinguished Software Engineer - USA-CA - Promontory E, United States
$200,000 - $320,000 USD yearly
Originally posted 2 October 2026 by the employer.
Join the Avi Engineering team to deliver Load balancing and Security solutions for the AI Era.
About the role
This role involves architecting and building high-performance, cloud-scale load balancing and security solutions, with a critical focus on envisioning and delivering highly resilient, microservices-based solutions for AI based workloads.
What you'll do
- Architect and build high-performance, cloud-scale load balancing and security solutions.
- Lead the design and implementation of Load balancing and Security solutions for AI workloads, including AI agents, LLMs, and Gateways.
- Build and optimize data pipelines capable of handling millions of records, ensuring platform scales elastically in AI environments.
- Leverage a sophisticated stack to build durable, stateful workflows to manage complex backend processes.
- Design schemas and optimize queries across a polyglot persistence layer (OpenSearch, PostgreSQL, Redis, and Neo4j) to provide time sensitive insights.
- Act as a key technical leader by conducting deep-dive code reviews, driving engineering best practices, and mentoring junior engineers.
What you'll need
- BS/MS/PhD in Engineering, Computer Science, or a related technical field.
- Experience: Bachelors with 20+ years; Masters with 18+ years; PhD with 15+ years of related experience.
- Proven experience building complex highly distributed systems.
- Proven experience leading the end-to-end lifecycle of a product, from initial design to production deployment and maintenance.
- Expert level proficiency in Go (concurrency, profiling, and performance tuning) and Python (data manipulation and backend services).
- Moderate level proficiency in C++ (maintain and optimize performance-critical components or interface with lower-level system libraries).
- Proven experience designing and delivering production-grade microservices for high-throughput, cloud-scale environments.
- Proficiency in gRPC, Google Protocol Buffers (Protobuf), and RESTful API design, with a deep understanding of the HTTP/S stack.
- Hands-on experience with OpenSearch/Elasticsearch, PostgreSQL, Redis, or Neo4j.
Nice to have
- Strong understanding of L4–L7 networking, TCP/IP, HTTP/S protocols, and load-balancing principles.
- Background in building data pipelines specifically for security and intelligence platforms.
- Familiarity with time-series data, stream processing, and large-scale data visualization backend logic.
Skills: Load balancing, Security solutions, AI workloads, distributed systems, microservices
This role has been open 7 days — well below the 51-day median for Infrastructure/Platform Software roles.
Infrastructure/Platform Software · Infrastructure Platform
|
Open roles in category
912
|
Median days open
51 d
|
Median salary
$229k
|
See the full market breakdown ▾Category comparison, skills in demand, and who else is hiring
| Metric | Broadcom | All employers we track in this specialty (912 roles · 86 employers) |
|---|---|---|
| Open roles in this specialty | 17 | 912 |
| Open roles in the wider Software, Firmware & Systems family | 78 | 6078 · 146 employers |
| Median days open | 44 d | 51 d (−7 d vs this employer) |
| Median salary (USD postings) | — | $229k |
Skills observed across this category: Load balancing, Security solutions, AI workloads, distributed systems, microservices
Who's hiring in this category
- NVIDIA · 250 open roles · median 49 d
- Qualcomm · 60 open roles · median 61 d
- AMD · 51 open roles · median 28 d
- Cerebras · 40 open roles · median 74 d
- Graphcore · 38 open roles · median 101 d
- Intel Corporation · 33 open roles · median 21 d
How we counted: 912 open Infrastructure/Platform Software (Infrastructure Platform) roles from 86 employers tracked in the SemiconductorJobs index, counted 9 Oct 2026. Specialty figures count only roles carrying this exact specialty label, so an employer's related work in neighbouring specialties is not included there — it is counted in the wider Software, Firmware & Systems family row. Figures refresh nightly.