Senior Systems Software Engineer - NVIDIA Cloud Functions

Overview

• NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years.
• It’s a unique legacy of innovation that’s fueled by great technology—and amazing people.
• Today, we’re tapping into the unlimited potential of AI to define the next era of computing.
• An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world.
• Doing what’s never been done before takes vision, innovation, and the world’s best talent.
• As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.
• Come join the team and see how you can make a lasting impact on the world.
• NVIDIA Cloud Functions (NVCF) is an Open Source Platform that links workloads to GPUs.
• It lets teams deploy, manage, and serve GPU-accelerated, containerized applications across regions and clusters worldwide.
• The platform routes inference, streaming, and batch jobs across decentralized GPU clusters.
• This allows endpoints to scale repeatably, whether hosted on-prem or in the cloud.
• We are seeking a Senior Systems Software Engineer to join our team.
• You will focus on improving the performance, reliability, and scaling behavior of a system that routes AI workloads onto distributed GPU fleets.
• You will work on a polyglot platform that is now fully open source, with both control plane and edge deployments.
• The work suits someone with deep experience in systems performance, distributed systems, and Kubernetes-based runtimes.
• We are looking for engineers who want to learn and grow.
• Expect to be challenged, in an environment with rapidly shifting priorities, where insight, focus and execution is key.
• What you'll be doing: You'll be working in a distributed team that explores innovative ways to make GPU and DPU accelerated applications easier to develop, deploy, and monitor on the latest and greatest NVIDIA hardware.
• Design and ship services in Java, Go and Rust, building in the open on a public repository where your commits, design proposals, and reviews are transparent to the community.
• Work on automating and optimizing build, test, integration, and release processes for cloud native.
• Partner with engineering teams across NVIDIA so the platform integrates with adjacent NVIDIA technologies, including the KAI Scheduler, NVIDIA NIM, Grove and Dynamo.
• Help steward an open-source project.
• You will triage community issues and pull requests, write docs contributors can build on.
• What we need to see: Bachelor’s or Master’s Degree in Computer Science or equivalent program from an accredited University/College and 8+ years of hands-on software engineering.
• Expert level knowledge in a systems programming language (Go, C, Rust) and proven understanding of Data Structures, Algorithms and Distributed Software Architecture Strong understanding of Container Orchestration Systems (Kubernetes) and Container Technologies with hands-on automation experience in continuous integration frameworks like Gitlab & ArgoCD.
• Expertise in a scripting language (Bash, Python) and knowledge and experience working with System internals of Unix/Unix-like kernels such as Linux.
• Understanding of performance, security and reliability in complex distributed systems.
• Ways to stand out from the crowd: Background with pub-sub models and message queues Experience optimizing for high-throughput network paths, with a working understanding of unary versus streaming and bidirectional protocols across HTTP/2 and gRPC.
• Experience with developing Kubernetes Custom Resources and Operators deployed in Cloud Service Providers We have some of the most hard-working and skilled people in the world working for us and our world-class engineering teams are growing fast.
• If you're a creative and self-motivated engineer with a real passion for technology, we want to hear from you!.