Software Engineer, AI Agents and Software Platforms

Overview

• NVIDIA is at the forefront of the AI revolution, delivering brand new accelerated compute platforms for global impact.
• Our Networking Research group is seeking a talented and motivated Software Engineer to spearhead the integration of autonomous AI agents across our internal and external platforms.
• In this high-impact role, you will architect the backbone for AI agent interaction, design scalable frameworks and SW development platforms.
• You will be a key player in redefining how our tools and services leverage generative AI.
• If you are passionate about building the practical infrastructure that brings intelligent agents to life, we want to hear from you.
• What you'll be doing: Architect and build robust, scalable frameworks and APIs to integrate AI agents with NVIDIA's suite of developer tools, simulation platforms, and enterprise software.
• Collaborate with research, applied AI, and product teams to understand agent capabilities and translate them into production-ready services and features.
• Design and implement CI/CD pipelines and MLOps for the AI agent and SW simulation products, including testing, deployment, monitoring, and continuous improvement.
• Optimize the performance, latency, and resource consumption of deployed AI agents, ensuring they operate efficiently within our compute infrastructure.
• Develop internal tooling and automation to streamline the onboarding of new AI agents and enhance the observability of agent fleets.
• Champion guidelines for secure and reliable agent-based systems, including data handling, access control, and interaction protocols.
• Serve as a key technical resource for solving sophisticated integration issues between AI agents and target applications.
• What we need to see: BSc or above in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• 3+ years of hands-on experience in software engineering, with a focus on backend systems, cloud services, or infrastructure.
• Proven experience with AI/ML frameworks (e.g., PyTorch, TensorFlow) and a strong understanding of large language models (LLMs), transformers, and agent-based architectures (e.g., LangChain, LlamaIndex).
• Proven experience in architecting, building and deploying complex integrations between AI agents and external tools, APIs, or software services.
• Expert-level programming skills in Python.
• Experience with C++ is a strong plus.
• Experience designing, building, and maintaining RESTful APIs, gRPC, and other service-to-service communication protocols.
• Excellent problem-solving skills and the ability to navigate complex, ambiguous technical challenges.
• Strong communication and interpersonal skills, with a proven ability to collaborate effectively across multidisciplinary teams.
• Ways to stand out from the crowd: Hands-on experience building or fine-tuning LLMs or other generative models.
• Prior experience with MLOPs, and agentic infrastructure.
• Contributions to open-source AI/ML projects.
• Experience with Infrastructure as Code (Terraform, Ansible).
• Prior experience in developing platforms for internal developer communities.
• Knowledge of cloud platforms (AWS, GCP, Azure), container orchestration (Kubernetes, Docker), and building scalable microservices.
• Familiarity with vector databases (e.g., Milvus, Pinecone) and model serving infrastructure (e.g., Triton Inference Server).
• NVIDIA is home to some of the most innovative and dedicated professionals in the industry.
• We are committed to fostering a diverse work environment and are proud to be an equal-opportunity employer.