Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local LLM Deployment
🏠 Local LLM Deployment
Specific
Model Optimization, GPU Acceleration, Inference, Privacy
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
434
posts in
6.7
ms
GGUF
vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
🖥️
Self-hosted apps
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
Ollama
0.30
GPU
Boost: Faster
local
Qwen inference on NVIDIA
🖥️
Self-hosted apps
everylocalai.com
·
4h
4 hours ago
·
DEV
Actions for Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA
Ollama
0.30 delivers faster NVIDIA
GPU
performance and wider hardware support
🖥️
Self-hosted apps
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Neo-X7/Neo-AI
: A fully offline
AI
assistant powered by
Ollama
. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
🖥️
Self-hosted apps
Content type:
Code
github.com
·
12h
12 hours ago
·
DEV
Actions for Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
lightmetal:
GPU
LLM
Inference
From a Single Java 25 JAR
🗃️
SQLite
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Improved performance and
model
support with
GGUF
🖥️
Self-hosted apps
Content type:
Blog
ollama.com
·
6d
6 days ago
Actions for Improved performance and model support with GGUF
On-device
AI
is a margin decision
🖥️
Self-hosted apps
Content type:
Blog
ziraph.com
·
6h
6 hours ago
·
Hacker News
Actions for On-device AI is a margin decision
Qwen 3.6 27B AutoRound
GGUF
, need your feedback
🗃️
SQLite
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
What
Ollama
Reveals About
Local
AI
, Agents, and Open Models
🖥️
Self-hosted apps
Content type:
Blog
odsc.medium.com
·
2h
2 hours ago
Actions for What Ollama Reveals About Local AI, Agents, and Open Models
Unsloth Gemma 4 QAT
🪟
Awesome windows command-line
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
I've tested so many desktop
AI
tools, but Hermes with
Ollama
is my new favorite - here's why
🖥️
Self-hosted apps
Content type:
News
Content type:
Tutorial
zdnet.com
·
10h
10 hours ago
Actions for I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why
Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial
LLM
Backends
🖥️
Self-hosted apps
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial LLM Backends
AMD's Lemonade SDK For
Local
AI
Adds NVIDIA
CUDA
Support
🖥️
Self-hosted apps
phoronix.com
·
8h
8 hours ago
Actions for AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
Gemma 4 QAT
models
:
Optimizing
model compression for mobile and laptop efficiency
🖥️
Self-hosted apps
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Fixing a stuck
Ollama
runner and building a
GPU
watchdog
🖥️
Self-hosted apps
patrickmccanna.net
·
2d
2 days ago
·
Hacker News
Actions for Fixing a stuck Ollama runner and building a GPU watchdog
Microsoft is killing the Copilot+ PC advantage, brings Windows 11’s
local
AI
to RTX 30+ PCs with 6GB
vRAM
🖥️
Self-hosted apps
windowslatest.com
·
43m
43 minutes ago
Actions for Microsoft is killing the Copilot+ PC advantage, brings Windows 11’s local AI to RTX 30+ PCs with 6GB vRAM
Show HN: Run
Llama.cpp
In-Process from Java with Project Panama FFM
🖥️
Self-hosted apps
deemwar-products.github.io
·
5d
5 days ago
·
Hacker News
Actions for Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM
iOS 27's most advanced
on-device
AI
needs 12GB of RAM – and most iPhones don't have it
🖥️
Self-hosted apps
Content type:
News
techspot.com
·
1d
1 day ago
Actions for iOS 27's most advanced on-device AI needs 12GB of RAM – and most iPhones don't have it
Gemma 4 QAT on 10GB Laptop:
Local
AI
with 6.7GB
VRAM
🖥️
Self-hosted apps
everylocalai.com
·
4h
4 hours ago
·
DEV
Actions for Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM
Running Qwen 35B MoE at 450k Context on a Single 32GB
GPU
🪟
Awesome windows command-line
local-llm.utop.workers.dev
·
3d
3 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help