Senior Solutions Architect, Gen AI

Benefits

• of our accelerated computing software and hardware.
• Build demonstrations and POCs for solutions that address critical business needs of our customers.
• Help in draft requirements for missing features to unblock progress at customers/partners.
• Educate customers on new NVIDIA GenAI technologies and platforms.
• Prepare and deliver technical training presentations and workshops.
• Build collateral (notebook/ blog) applied to the industry use-cases.
• Partner with NVIDIA engineering, product, sales teams to secure design wins at customers.
• Enable development and growth of NVIDIA product features through customer feedback and POC evaluations.
• What We Need To See: Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience. 8+ years of hands-on experience in a technical AI role, with a strong emphasis on Gen AI.
• Proficient in the latest and greatest model architectures and be able to articulate the computational complexities of each.
• Proven track record of deploying and optimizing LLM models for inference in production environments using well known inferencing engines e.g., vLLM, TRT-LLM, SGLang, etc.
• Expertise in training and fine-tuning LLMs using popular frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.
• Solid understanding of GPU cluster architecture and the ability to bring to bear parallel processing for accelerated model training and inference.
• Experience with basic DevOps tools e.g., Docker, Kubernetes, GitLab, Linux Command Line, Shell, etc.
• Excellent communication and teamwork skills with the ability to explain complex technical concepts to both technical and non-technical collaborators.
• Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.
• Ways To Stand Out From The Crowd: Experience with Agentic AI frameworks, tools, and protocols e.g., LangChain, LangGraph, MCP.
• Understand Multimodal LLMs, VLMs, etc.
• Experience in deploying LLM models at scale on mainstream cloud providers (e.g., AWS, Azure, GCP).
• Proven track record to profile and optimize inference latency and throughput, memory and I/O utilization.
• Mathematical understanding of different parallelisation techniques in Gen AI Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 184,000 USD - 287,500 USD.
• You will also be eligible for equity and benefits .
• Applications for this job will be accepted at least until June 6, 2026.
• This posting is for an existing vacancy.
• NVIDIA uses AI tools in its recruiting processes.
• As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.