Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local llm
🧠 Local llm
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
228
posts in
4.8
ms
Show HN: Run
Llama.cpp
In-Process from Java with Project Panama FFM
🧠
LLM Inference
deemwar-products.github.io
·
5d
5 days ago
·
Hacker News
Actions for Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM
Ollama
0.30 delivers faster NVIDIA
GPU
performance and wider hardware support
⚡
LLM Quantization
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Ollama
0.30
GPU
Boost: Faster
local
Qwen inference on NVIDIA
🤖
Qwen
everylocalai.com
·
10h
10 hours ago
·
DEV
Actions for Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA
Neo-X7/Neo-AI: A fully offline AI assistant powered by
Ollama
. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
📝
SQLite WAL
Content type:
Code
github.com
·
18h
18 hours ago
·
DEV
Actions for Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.
Qwen 3.6 27B AutoRound
GGUF
, need your feedback
⚡
LLM Quantization
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
Improved performance and model support with
GGUF
⚡
LLM Quantization
Content type:
Blog
ollama.com
·
6d
6 days ago
Actions for Improved performance and model support with GGUF
What
Ollama
Reveals About
Local
AI, Agents, and Open Models
🔌
Model Context Protocol
Content type:
Blog
odsc.medium.com
·
8h
8 hours ago
Actions for What Ollama Reveals About Local AI, Agents, and Open Models
lightmetal:
GPU
LLM
Inference From a Single Java 25 JAR
⚡
LLM Quantization
Content type:
Blog
adambien.blog
·
2d
2 days ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
GGUF
vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
⚡
LLM Quantization
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
I've tested so many desktop AI tools, but Hermes with
Ollama
is my new favorite - here's why
🤖
Qwen
Content type:
News
Content type:
Tutorial
zdnet.com
·
16h
16 hours ago
Actions for I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why
Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
🧠
LLM Inference
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
I wired a fully offline voice loop to
Ollama
+
LM
Studio
— 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)
🤖
Machine Learning
Content type:
Code
github.com
·
4h
4 hours ago
·
r/LocalLLaMA
Actions for I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)
Unsloth Gemma 4 QAT
⚡
LLM Quantization
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
Fixing a stuck
Ollama
runner and building a
GPU
watchdog
🏠
Self-Hosting
patrickmccanna.net
·
2d
2 days ago
·
Hacker News
Actions for Fixing a stuck Ollama runner and building a GPU watchdog
Video: So installiert und nutzt ihr
lokale
KI-Modelle
🧠
LLM Inference
Content type:
News
heise.de
·
23h
23 hours ago
Actions for Video: So installiert und nutzt ihr lokale KI-Modelle
local
llm
on laptop 780M
GPU
using llama + gemma 4 qat
⚡
LLM Quantization
Content type:
Blog
alper.bearblog.dev
·
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
I added this open-source tool to my
local
AI stack, and my
local
LLM
finally has persistent memory
🧠
LLM Inference
xda-developers.com
·
1d
1 day ago
Actions for I added this open-source tool to my local AI stack, and my local LLM finally has persistent memory
An
LLM
that reviews your code, challenges your decisions, but never writes code for you
🤖
Qwen
Content type:
Blog
blog.adafruit.com
·
11h
11 hours ago
Actions for An LLM that reviews your code, challenges your decisions, but never writes code for you
Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
🧠
LLM Inference
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Tales of an
Ollama
Honeypot (Part 3): More Traffic, More Findings
📊
Prometheus
posts.inthecyber.com
·
2d
2 days ago
Actions for Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help