R&D Distinguished Software Engineer

About This Role

• Job Description Join the Avi Engineering team as a Distinguished Engineer to deliver Load balancing and Security solutions for the AI Era.
• The team has a storied history of innovation and an extensive patent portfolio.
• We foster a culture of intellectual curiosity turning creative ideas into tangible solutions.
• You’ll fit right in if you're someone who adopts a first-principles approach to problem-solving, love deep-diving into distributed systems to optimize scale and performance, and enjoy the challenge of making data flow seamlessly at a massive scale.
• This on-site position is based in Palo Alto, California.
• You will join a global, cross-border team of talented engineers operating across India, Germany, and the USA.
• Key Responsibilities As a Distinguished Engineer, you will be architecting and building high-performance, cloud-scale load balancing and security solutions.
• You will play a critical role in envisioning and delivering highly resilient, microservices-based solutions in the emerging world of AI based workloads.
• Architectural Leadership: Lead the design and implementation of Load balancing and Security solutions for AI workloads, including but not limited to AI agents, LLMs, and Gateways.
• Scale & Performance: Build and optimize data pipelines capable of handling millions of records, ensuring the platform scales elastically in AI environments.
• Tech Stack Orchestration: Leverage a sophisticated stack to build durable, stateful workflows to manage complex backend processes.
• Data Strategy: Design schemas and optimize queries across a polyglot persistence layer (OpenSearch, PostgreSQL, Redis, and Neo4j) to provide time sensitive insights to customers.
• Mentorship: Act as a key technical leader by conducting deep-dive code reviews, driving engineering best practices, and mentoring junior engineers.
• Required Skills & Experience Professional Experience Education: BS/MS/PhD in Engineering Computer Science or a related technical field.
• Experience : Bachelors with 20+ years; Masters with 18+ years; PhD with 15+ years of related experience Proven experience building complex highly distributed systems Proven experience leading the end-to-end lifecycle of a product, from initial design to production deployment and maintenance.
• Programming Proficiency Expert Level (GoLang & Python): Deep mastery of Go (concurrency, profiling, and performance tuning) and Python (data manipulation and backend services).
• Moderate Level (C++): Ability to maintain and optimize performance-critical components or interface with lower-level system libraries.
• Cloud-Native Architecture & API Design Microservices at Scale: Proven experience designing and delivering production-grade microservices for high-throughput, cloud-scale environments.
• Communication Protocols: Proficiency in gRPC, Google Protocol Buffers (Protobuf), and RESTful API design, with a deep understanding of the HTTP/S stack.
• Data Persistence & Search: Hands-on experience with one or more of the following: OpenSearch/Elasticsearch, PostgreSQL, Redis, or Neo4j (or their equivalents).
• Desired Skills & Qualifications Networking Domain Expertise: Strong understanding of L4–L7 networking, TCP/IP, HTTP/S protocols, and load-balancing principles.
• Advanced Data Engineering: Background in building data pipelines specifically for security and intelligence platforms (e.g., threat detection, anomaly detection, or predictive analytics).
• Analytics Background: Familiarity with time-series data, stream processing, and large-scale data visualization backend logic.
• Compensation and Benefits The annual base salary range for this position is USD 200,000.00 To USD 320,000.00 As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth.
• All subject to relevant plan documents and award agreements.
• Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time.
• The company follows all applicable laws for Paid Family Leave and other leaves of absence.
• We will also consider qualified applicants with arrest and conviction records consistent with local law.
• If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.