Back to article
GitHub

sgl-project/sglang (opens in new tab)

Covered by 7 sources See all sources covering this story including XDA, Cloud Native Now

Covered in 9 articles

XDA·

Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious

Feeds
Cloud Native Now·

Google OpenRL Tames AI Model Tuning, Kubernetes-Style

Feeds
huggingface.co·

zai-org/GLM-5.2 is here!

Feeds
huggingface.co·

Mi50 32GB / GFX906 - vLLM Qwen 3.5 Configuration for Qwen 3.5:9B AWQ-4bit

Discussed on r/LocalLLaMA
Feeds
huggingface.co·

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)

Discussed on r/LocalLLaMA
Feeds
digitalocean.com·

The MoE-ification of the Open Model Ecosystem, and What It Means for Your Inference Bill

Feeds
mlsys.wuklab.io·

Nitsum: Serving Tiered LLM Requests with Adaptive Tensor Parallelism

Discussed on Hacker News
Feeds
blog.skypilot.co·

RL Doesn't Work on Slurm

Discussed on Hacker News
Feeds

In other languages

habr.com·

Мой личный джун. Часть 1. Учим агента писать код и пользоваться git

Feeds

Keyboard Shortcuts

Navigation

Next / previous post
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Discover
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help