Intern, ML Compiler (Kernel Auto-Tuning)
Opens job-boards.greenhouse.io in a new tab
Overview
- To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.
- Advancing the World’s Technology Together
- Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more.
- Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future.
- We believe innovation and growth are driven by an inclusive culture and a diverse workforce.
- We’re dedicated to empowering people to be their true selves.
- Together, we’re building a better tomorrow for our employees, customers, partners, and communities.
- What You'll Learn
- Project Overview: Build a cost-model-guided auto-tuning framework for PyTorch and Triton kernels on Samsung’s compute-near-memory AI accelerator, and make it placement-aware, so that each kernel is tuned for where its data lives.
- You’ll connect it to torch.compile and measure the gains on LLM inference.
- Skills You’ll Learn:
- Performance optimisation for a cache-less, DMA-driven accelerator: search spaces, legality rules and cost models
- PyTorch compiler internals (torch.compile, FX, Inductor autotuning) and Triton kernel compilation
- Benchmarking and profiling LLM inference kernels (GEMM, attention) on simulators and hardware
- Our ML Compiler team builds the software that runs PyTorch models on Samsung’s compute-near-memory AI accelerator: a PyTorch device and compiler backend, a Triton-based kernel compiler and an LLVM back end.
- We work closely with the runtime and hardware teams and with the PyTorch and Triton open-source communities.
- Over the summer you’ll own one piece of making ordinary PyTorch models fast on new memory-centric hardware, from research idea to merged, measured code.
- Location: Daily onsite presence at our San Jose Headquarters in alignment with our Flexible Work policy
- Reports to: Director
- Design a search space for Triton kernel configurations on the accelerator: tile sizes, launch-grid mapping, on-chip buffer budgets and load style.
- Build legality rules with our compiler engineers that prune configurations that will not compile or will not fit in on-chip memory.
- Develop a kernel cost model, calibrated against our simulator and profiler, that ranks candidates so only the most promising are benchmarked.
- Build a reliable benchmarking harness and a persistent tuning cache, so that tuning cost stays practical.
- Integrate the tuner with the torch.compile Inductor autotuning path and with Triton’s autotuner.
- Extend tuning to data placement: tune kernels for a given tensor layout and export tuned costs that a placement pass can use.
- Measure kernel-level and end-to-end LLM inference gains, and share results in weekly syncs and a final presentation.
- Collaborate with PyTorch and Triton developers on upstream autotuning hooks, and hand off documented, tested code.
What You'll Do
- Pursuing a Masters or PhD in Computer Science, Computer Engineering or Electrical Engineering; PhD preferred.
- Must have at least 1 academic quarter/semester remaining
- Strong Python and C++, with experience writing or tuning Triton kernels or working with PyTorch compiler internals (torch.compile, FX, Inductor).
- Grounding in compilers or performance engineering: IR and passes, cost models, roofline analysis and profiling.
- Preferred: auto-tuning or auto-sharding experience (e.g.
- TVM/Ansor, the Halide autoscheduler, Kernel Tuner, Alpa, GSPMD), or search methods such as Bayesian optimisation or ILP.</li
Sourced directly from Samsung Semiconductor’s career page
Your application goes straight to Samsung Semiconductor.
More from Samsung Semiconductor (70 roles)
Samsung Semiconductor
Sustainability Manager
San Jose, California, United States|Other
Samsung Semiconductor
Senior Staff Engineer – NVMe SSD Firmware Validation
San Jose, California, United States|Embedded
Samsung Semiconductor
Senior Engineer, Design Verification
San Jose, California, United States|Verification
Opens job-boards.greenhouse.io in a new tab
Get matched to roles like this
Upload your resume once. We’ll notify you when matching roles open up.
Join talent pool — freeSimilar Other roles
Samsung Semiconductor
Sustainability Manager
San Jose, California, United States|Other
Samsung Semiconductor
Intern, Compiler Engineer
San Jose, California, United States|Other
Samsung Semiconductor
Intern, AI Systems Performance Engineer
San Jose, California, United States|Other
Samsung Semiconductor
Intern, AI System Architecture Research Scientist
San Jose, California, United States|Other