Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local AI
💻 Local AI
local inference, ollama, llama.cpp, on-premise LLM
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
276
posts in
10.3
ms
Improved performance and model support with
GGUF
🔓
Open Source AI
Content type:
Blog
ollama.com
·
5d
5 days ago
Actions for Improved performance and model support with GGUF
Ollama
0.30 delivers faster NVIDIA GPU performance and wider hardware support
🔓
Open Source AI
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Neo-X7/Neo-AI
: A fully
offline
AI
assistant powered by
Ollama
. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
🔓
Open Source AI
Content type:
Code
github.com
·
6h
6 hours ago
·
DEV
Actions for Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
On-device
AI
is a margin decision
🔬
Small LMs
Content type:
Blog
ziraph.com
·
1h
1 hour ago
·
Hacker News
Actions for On-device AI is a margin decision
lightmetal: GPU
LLM
Inference
From a Single Java 25 JAR
⚡
Quantization
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Show HN: Run
Llama.cpp
In-Process from Java with Project Panama FFM
🔓
Open Source AI
deemwar-products.github.io
·
5d
5 days ago
·
Hacker News
Actions for Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM
I've tested so many desktop
AI
tools, but Hermes with
Ollama
is my new favorite - here's why
🔓
Open Source AI
Content type:
News
Content type:
Tutorial
zdnet.com
·
5h
5 hours ago
Actions for I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why
Qwen 3.6 27B AutoRound
GGUF
, need your feedback
⚡
Quantization
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
local
llm
on laptop 780M GPU using
llama
+ gemma 4 qat
🤖
LLMs
Content type:
Blog
alper.bearblog.dev
·
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
Fixing a stuck
Ollama
runner and building a GPU watchdog
🔓
Open Source AI
patrickmccanna.net
·
1d
1 day ago
·
Hacker News
Actions for Fixing a stuck Ollama runner and building a GPU watchdog
FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
⚡
Quantization
Content type:
Academic
arxiv.org
·
15h
15 hours ago
Actions for FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
Unsloth Gemma 4 QAT
⚡
Quantization
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
Tales of an
Ollama
Honeypot (Part 3): More Traffic, More Findings
🔓
Open Source AI
posts.inthecyber.com
·
2d
2 days ago
Actions for Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings
Re-quantizing
a
local
LLM
14x faster by skipping the tensors that didn't change
🤖
LLMs
Content type:
News
Content type:
Blog
andreaborio.substack.com
·
6h
6 hours ago
·
Substack
Actions for Re-quantizing a local LLM 14x faster by skipping the tensors that didn't change
Using
Scikit-LLM
with Open-Source LLMs
🔓
Open Source AI
machinelearningmastery.com
·
6d
6 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
WWDC 2026: Foundation Models (& Anarlog)
🔓
Open Source AI
skushagra.com
·
1d
1 day ago
Actions for WWDC 2026: Foundation Models (& Anarlog)
GGUF
vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
⚡
Quantization
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
A system programmer’s guide to
LLM
inference
⚡
Continuous Batching
Content type:
Blog
blog.xiangpeng.systems
·
2d
2 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
147th airhacks tv:
Local
LLMs, LightMetal, ZSmith Agents,
AI
Rails, Saving Tokens
🤖
LLMs
Content type:
Blog
adambien.blog
·
16h
16 hours ago
Actions for 147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens
Making
Local
LLM
Go Brrr
🤖
LLMs
seanpedersen.github.io
·
6d
6 days ago
Actions for Making Local LLM Go Brrr
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help