AI Framework Software Engineer – SGlang & Kernels

About This Role

• Conducts design and development to build and optimize AI software.
• Designs, develops, and optimizes for AI frameworks (e.g., SGLang) and contribute to public upstream.
• Implements various distributed algorithms such as model/data parallel frameworks, parameter servers, dataflow based asynchronous data communication in machine learning, and/or deep learning frameworks.
• Transforms computational graph representation of neural network model, and develops machine learning and/or deep learning primitives in mathematical libraries.
• Profiles distributed deep learning models to identify performance bottlenecks and proposes solutions across individual component teams.
• Optimizes code for various computing hardware backends, and interacts with machine learning and/or deep learning researchers, and utilizing experience with machine learning and/or deep learning frameworks.