Senior Software AI Engineer, LLM Solutions

Overview

• Our System Design Automation team is looking for an AI Engineer with solid software skills to join our engineering group.The team develops and sustains a range of tools and capabilities for NVIDIA's current and next-generation hardware platforms — including LLM-powered automation and intelligent debugging solutions, alongside traditional software engineering tools.Our work accelerates issue resolution, improves product reliability, and powers the world's most advanced GPU and data center technologies.NVIDIA's Hardware Networking division is a global leader in end-to-end accelerated computing and connectivity for high-performance data centers — spanning GPUs, networking platforms, and AI software across cloud, HPC, autonomous vehicles, and media & entertainment.
• What You'll Be Doing: Develop and support software tools across the engineering stack — from data processing and backend services to user-facing interfaces Build and maintain data pipelines and ETL flows for logs, telemetry, and hardware test data supporting AI/ML workflows Prepare, clean, and structure large, complex datasets (structured & unstructured) for LLM training and fine-tuning Develop and deploy LLM-based applications for root cause analysis and hardware debugging Design and implement agentic workflows — multi-step, tool-using AI agents capable of autonomous reasoning and action Experiment with prompt engineering, RAG, and vector search to integrate domain knowledge into models Collaborate with hardware, reliability, and AI platform teams to embed intelligent tools into NVIDIA's engineering ecosystem What We Need to See: B.Sc.
• in Computer Science, Electrical/Computer Engineering, Data Science, or equivalent practical experience 5+ years of experience in software engineering with AI/ML or a related field Strong Python skills (pandas, NumPy, PyTorch or TensorFlow) Solid understanding of deep learning fundamentals and strong interest in LLMs/NLP Hands-on experience with Linux, Git, and container tools (e.g., Docker) Strong analytical and problem-solving skills Eagerness to learn complex hardware/software systems Ways to Stand Out from the crowd Experience with full-stack or frontend web development, particularly building internal tools or dashboards using React Hands-on experience designing and implementing agentic workflows (e.g., LangChain, LangGraph, AutoGen, or similar frameworks) Experience with LLM fine-tuning, prompt engineering, or RAG pipelines Familiarity with hardware debugging, observability/logging systems, or chip/system reliability analysis Experience with vector databases (FAISS, Pinecone, Milvus) or MLOps tools (MLflow, Kubeflow) NVIDIA is widely considered one of the technology world’s most desirable employers.
• We have some of the most talented and forward-thinking individuals in the world working for us.
• We highly value diversity in our current and future employees and do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.