Back to article

sgl-project/sglang (opens in new tab)

Covered by 8 sources including XDA, Cloud Native Now

Covered in 13 articles

Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious

Cloud Native Now·

Google OpenRL Tames AI Model Tuning, Kubernetes-Style

5 Open Source Omni AI Models That Handle Text, Images, Audio, and Video

krea/Krea-2-Raw

Qwen-AgentWorld-35B-A3B: a 3B-active MoE trained to simulate MCP, terminal, SWE, Android, web and OS environments

Discussed on r/LocalLLaMA

zai-org/GLM-5.2 is here!

Discussed on Hacker News, Hacker News, and r/LocalLLaMA

Mi50 32GB / GFX906 - vLLM Qwen 3.5 Configuration for Qwen 3.5:9B AWQ-4bit

Discussed on r/LocalLLaMA

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)

Discussed on r/LocalLLaMA

digitalocean.com·

The MoE-ification of the Open Model Ecosystem, and What It Means for Your Inference Bill

mlsys.wuklab.io·

Nitsum: Serving Tiered LLM Requests with Adaptive Tensor Parallelism

Discussed on Hacker News

In other languages

6 минут назад

Мой личный джун. Часть 1. Учим агента писать код и пользоваться git