Intern - AI Systems and Infrastructure Engineering

Requirements

• Currently pursuing a Master's or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
• Demonstrated experience with AI systems, machine learning systems, computer systems research, or systems software development through coursework, research, or projects.
• Understanding of Large Language Models (LLMs), including transformer execution, attention mechanisms, KV cache behavior, batching, token-level latency, throughput, and memory performance considerations.
• Proficiency in Python and C/C++, with hands-on experience developing, debugging, and optimizing software in Linux environments.
• Experience using GPU-based performance analysis tools and at least one modern AI framework or serving stack, such as PyTorch, vLLM, TensorRT-LLM, NVIDIA Dynamo, or related technologies.
• Preferred Qualifications Experience extending or optimizing LLM runtimes, serving engines, schedulers, or distributed inference frameworks.
• Hands-on experience implementing advanced KV-cache, memory management, or state-management techniques for long-context or stateful AI applications.
• Experience with GPU optimization technologies such as CUDA, Triton, NCCL, RDMA, or similar accelerator and communication frameworks.
• Familiarity with heterogeneous memory architectures, including HBM, DRAM, CXL-attached memory, NVMe storage, pooled memory, or disaggregated memory systems.
• Evidence of significant technical impact through publications, patents, open-source contributions, or substantial research and engineering projects related to Artificial Intelligence, distributed systems, memory systems, or high-performance computing.
• As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth.
• Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future.
• We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget.
• Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave.
• Additionally, Micron benefits include a robust paid time-off program and paid holidays.
• For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits .
• Micron is proud to be an equal opportunity workplace and is an affirmative action employer.
• To learn about your right to work click here.
• To learn more about Micron, please visit micron.com/careers For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at hrsupport_na@micron.com or 1-800-336-8918 (select option #3) Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
• Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.
• AI alert : Candidates are encouraged to use AI tools to enhance their resume and/or application materials.
• However, all information provided must be accurate and reflect the candidate's true skills and experiences.
• Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
• Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.