Back to jacob.bradley0011's feed

sgl-project/sglang (opens in new tab)  🔄SDLC  7 articles covering this post

github.com··Covered by xda-developers.com + 5 more·Open original (opens in new tab)
Sign in to keep reading the full article.
Sign UpLog In

Covered in 7 articles

Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious

xda-developers.com·

Mi50 32GB / GFX906 - vLLM Qwen 3.5 Configuration for Qwen 3.5:9B AWQ-4bit

huggingface.co··r/LocalLLaMA

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)

huggingface.co··r/LocalLLaMA
View all 7 ›

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help