SGLang is a high-performance serving framework for large language models and multimodal models.
@sgl-project/sglang
Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jit_kernel module