Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local LLMs
🏠 Local LLMs
Specific
local models, offline LLM, llama, on-device inference
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
440
posts in
13.8
ms
Neo-X7/Neo-AI: A fully
offline
AI assistant powered by
Ollama
. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
🤗
Open Source AI
Content type:
Code
github.com
·
14h
14 hours ago
·
DEV
Actions for Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
Running
Qwen
35B MoE at 450k Context on a Single 32GB GPU
🟢
NVIDIA
local-llm.utop.workers.dev
·
3d
3 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
What's in the Box? A Field Guide to AI
Models
🧠
LLMs
Content type:
Blog
iankduncan.com
·
2d
2 days ago
Actions for What's in the Box? A Field Guide to AI Models
Optimal Post-Training
Quantization
Scales and Where to Find Them
🧠
LLMs
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Optimal Post-Training Quantization Scales and Where to Find Them
The biggest
local
LLM
on your machine is useless if it can't call a single tool, no matter how many parameters it has
🤗
Open Source AI
xda-developers.com
·
9h
9 hours ago
Actions for The biggest local LLM on your machine is useless if it can't call a single tool, no matter how many parameters it has
lightmetal: GPU
LLM
Inference
From a Single Java 25 JAR
🤗
Open Source AI
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Gemma 4 QAT
models
: Optimizing model compression for mobile and laptop efficiency
🤗
Open Source AI
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Less-relevant results
On-device
AI is a margin decision
🤗
Open Source AI
Content type:
Blog
ziraph.com
·
8h
8 hours ago
·
Hacker News
Actions for On-device AI is a margin decision
"AI" Is Eating Platform Monopolist Free Cash Flow, Not the World: CHART OF THE DAY
🤗
Open Source AI
Content type:
News
Content type:
Blog
braddelong.substack.com
·
2d
2 days ago
·
Substack
Actions for "AI" Is Eating Platform Monopolist Free Cash Flow, Not the World: CHART OF THE DAY
LM
Studio
now lets you use your iPhone to talk to
local
models on your Mac
🤗
Open Source AI
9to5mac.com
·
6d
6 days ago
·
r/apple
Actions for LM Studio now lets you use your iPhone to talk to local models on your Mac
NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet
🌐
Web Dev
huggingface.co
·
2d
2 days ago
·
Hacker News
Actions for NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet
MoQ
GGUFs
and GSQ: Low-Bit
GGUFs
Are About to Get Much Better
🧠
LLMs
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
5d
5 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
Previewing nAnalyst, the layer that finally explains your network
🤖
AI Coding
ntop.org
·
1d
1 day ago
Actions for Previewing nAnalyst, the layer that finally explains your network
Using
local
LLMs
for agentic coding
🤗
Open Source AI
Content type:
Blog
blog.alexewerlof.com
·
6d
6 days ago
Actions for Using local LLMs for agentic coding
Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
🤗
Open Source AI
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by
local
LLMs
. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.
🤗
Open Source AI
Content type:
Code
github.com
·
11h
11 hours ago
·
Hacker News
Actions for martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by local LLMs. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.
WWDC 2026: Foundation
Models
(& Anarlog)
🤗
Open Source AI
skushagra.com
·
2d
2 days ago
Actions for WWDC 2026: Foundation Models (& Anarlog)
The latest Gemma 4
models
use a training trick to slash their
on-device
memory footprint
🤗
Open Source AI
androidauthority.com
·
5d
5 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
Re-quantizing
a
local
LLM
14x faster by skipping the tensors that didn't change
🤗
Open Source AI
Content type:
News
Content type:
Blog
andreaborio.substack.com
·
13h
13 hours ago
·
Substack
Actions for Re-quantizing a local LLM 14x faster by skipping the tensors that didn't change
Apples to Apples: MLX vs.
Llama.cpp
for Gemma 4 12B on an M1 16GB
🤗
Open Source AI
Content type:
Blog
ziraph.com
·
5d
5 days ago
·
Hacker News
Actions for Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help