Senior Software Developer, AI Networking

Overview

• NVIDIA is changing the world of AI Networking with groundbreaking technology.
• We are excited to be adding an AI Networking Software Developer to our AI Networking SW development and codesign team.
• We are working with the latest NVIDIA hardware and technologies.
• We do full stack benchmarking for Data Center scale systems for AI training/inference and lower level benchmarks.
• We strive for automation and develop many tools in-house yet adopt community accepted practices and frameworks.
• Moreover we give back to community developing our own tools in public GitHub repositories.
• Our goal is to ensure that large-scale systems deliver expected performance in practice, not just on paper, by uncovering bottlenecks and driving continuous improvements.
• What you'll be doing : Developing AI networking communication frameworks and applications running in production on the world’s largest supercomputers and data centers.
• Develop production tools and benchmarks used by multiple teams inside and outside NVIDIA.
• Enable new AI models within our benchmarking infrastructure and deliver insights through end-to-end analysis of large-scale workloads across hardware and software stacks.
• Design and implement automation systems, including large-scale parameter search to identify optimal configurations across complex systems.
• Collaborate closely with networking and hardware teams to co-design new features and software interfaces in a fast-paced, evolving environment.
• What we need to see: B.Sc., M.Sc degree in Computer Science / Software engineering, and 5+ years or equivalent experience.
• Professional Python development experience.
• We seek individuals who build maintainable, long-lived tools that do not impose a heavy burden on the team in terms of maintenance.
• Solid Linux expertise and passion for working extensively in command-line environments.
• Ability to work across a broad and evolving stack, with a strong drive to learn—from hardware and networking up to large-scale AI systems running across entire clusters Ways to stand out from the crowd: Knowledge and/or experience with modern AI ecosystem: PyTorch, LLMs, inference and training.
• Familiarity with cluster orchestration systems such as Slurm or Kubernetes.
• Knowledge in MPI and HPC, InfiniBand, Ethernet and Networking.
• Experience in performance optimizations For two decades, we have pioneered visual computing, and the art and science of computer graphics.
• With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, product design, medical diagnosis and scientific research.
• Today, we stand at the beginning of the next era, the AI computing era, ignited by a new computing model, GPU deep learning.
• This new model - where deep neural networks are trained to recognize patterns from massive amounts of data - has shown to be deeply effective at solving some of the most complex problems in everyday life.
• NVIDIA is widely considered to be one of the technology world's most desirable companies to work for.
• Are you creative and driven? Do you love a challenge? If so, we want to hear from you.