Back to article

sgl-project/sglang (opens in new tab) 7 articles covering this post

github.com··Open original

Covered in 7 articles

Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious

xda-developers.com·

Mi50 32GB / GFX906 - vLLM Qwen 3.5 Configuration for Qwen 3.5:9B AWQ-4bit

huggingface.co··r/LocalLLaMA

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)

huggingface.co··r/LocalLLaMA

The MoE-ification of the Open Model Ecosystem, and What It Means for Your Inference Bill

digitalocean.com·

Nitsum: Serving Tiered LLM Requests with Adaptive Tensor Parallelism

mlsys.wuklab.io··Hacker News

RL Doesn't Work on Slurm

blog.skypilot.co··Hacker News

In other languages

Мой личный джун. Часть 1. Учим агента писать код и пользоваться git