Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
LLM serving frameworks
🚀 LLM serving frameworks
Specific
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
240
posts in
8.6
ms
DiffusionGemma: The Developer Guide- Google Developers Blog
🔧
Systems-level optimizations for LLM serving
Content type:
Blog
developers.googleblog.com
·
1d
1 day ago
·
r/LocalLLaMA
Actions for DiffusionGemma: The Developer Guide- Google Developers Blog
Unsloth Gemma 4 QAT
✨
Model optimizations in LLMs
unsloth.ai
·
6d
6 days ago
Actions for Unsloth Gemma 4 QAT
Show HN: Run
Llama.cpp
In-Process from Java with Project Panama FFM
🧠
Large Language Models (LLMs)
deemwar-products.github.io
·
6d
6 days ago
·
Hacker News
Actions for Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM
Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM
📊
AI Performance Profiling
everylocalai.com
·
1d
1 day ago
·
DEV
Actions for Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM
AI
Serving
Platform That Adapts to Your Model
📊
AI Performance Profiling
Content type:
Blog
databricks.com
·
1d
1 day ago
Actions for AI Serving Platform That Adapts to Your Model
Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
✨
Model optimizations in LLMs
Content type:
News
Content type:
Blog
blog.google
·
6d
6 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Less-relevant results
Google's new open-weights model brings
image-generation
tricks to AI
text
generation
🧠
Large Language Models (LLMs)
Content type:
News
theregister.com
·
5h
5 hours ago
Actions for Google's new open-weights model brings image-generation tricks to AI text generation
DiffusionGemma 26B A4B results on my 5090
🧠
Large Language Models (LLMs)
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for DiffusionGemma 26B A4B results on my 5090
Fixing a stuck
Ollama
runner and building a GPU watchdog
📊
AI Performance Profiling
patrickmccanna.net
·
3d
3 days ago
·
Hacker News
Actions for Fixing a stuck Ollama runner and building a GPU watchdog
What
Ollama
Reveals About Local AI, Agents, and Open Models
🤖
Agents using LLMs
Content type:
Blog
odsc.medium.com
·
1d
1 day ago
Actions for What Ollama Reveals About Local AI, Agents, and Open Models
Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
📊
AI Performance Profiling
local-llm.utop.workers.dev
·
4d
4 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
What's in the Box? A Field Guide to AI Models
🧠
Large Language Models (LLMs)
Content type:
Blog
iankduncan.com
·
2d
2 days ago
Actions for What's in the Box? A Field Guide to AI Models
Apples to Apples: MLX vs.
Llama.cpp
for Gemma 4 12B on an M1 16GB
🧠
Large Language Models (LLMs)
Content type:
Blog
ziraph.com
·
6d
6 days ago
·
Hacker News
Actions for Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
fix(
ollama
): use provider thinking default in SDK session factory (#9… · openclaw/openclaw@4f3c2cd
🤖
Agents using LLMs
Content type:
Code
github.com
·
12h
12 hours ago
Actions for fix(ollama): use provider thinking default in SDK session factory (#9… · openclaw/openclaw@4f3c2cd
2x GH200 for
LLM
inference
, Part 2:
vLLM
, DeepSeek V4 Flash, and MTP
🔧
Systems-level optimizations for LLM serving
Content type:
Blog
dnhkng.github.io
·
4d
4 days ago
Actions for 2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP
On-device AI is a margin decision
🧠
Large Language Models (LLMs)
Content type:
Blog
ziraph.com
·
1d
1 day ago
·
Hacker News
Actions for On-device AI is a margin decision
GGUF vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
🔢
Quantization of LLMs
vettedconsumer.com
·
5d
5 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
An
LLM
that reviews your code, challenges your decisions, but never writes code for you
💬
Prompt optimizations for LLM serving
Content type:
Blog
blog.adafruit.com
·
1d
1 day ago
Actions for An LLM that reviews your code, challenges your decisions, but never writes code for you
CommBench: Can LLMs Write Correct and Efficient GPU Communication Code?
⚙️
AI Infrastructure Automation
uccl-project.github.io
·
16h
16 hours ago
·
Hacker News
Actions for CommBench: Can LLMs Write Correct and Efficient GPU Communication Code?
How we fight GPU scarcity without compromise
🧠
Large Language Models (LLMs)
Content type:
Blog
equixly.com
·
6d
6 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help