Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local LLM
馃 Local LLM
Specific
running locally, DGX-Spark, Ollama, lama.cpp
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
380
posts in
14.0
ms
Show HN:
Run
Llama.cpp
In-Process from Java with Project Panama FFM
聽
馃
AI
deemwar-products.github.io
路
5d
5 days ago
路
Hacker News
Actions for Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM
lightmetal:
GPU
LLM
Inference
From a Single Java 25 JAR
聽
馃
AI
聽
Content type:
Blog
adambien.blog
路
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Ollama
0.30 delivers faster NVIDIA
GPU
performance and wider hardware support
聽
馃
AI
alternativeto.net
路
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Unsloth
Gemma
4 QAT
聽
馃
AI
unsloth.ai
路
4d
4 days ago
Actions for Unsloth Gemma 4 QAT
Improved performance and model support with
GGUF
聽
馃
AI
聽
Content type:
Blog
ollama.com
路
5d
5 days ago
Actions for Improved performance and model support with GGUF
local
llm
on laptop 780M
GPU
using llama + gemma 4 qat
聽
馃
LLMs
聽
Content type:
Blog
alper.bearblog.dev
路
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
zhongkaifu/TensorSharp: A C#
inference
engine for
running
large language models (LLMs)
locally
using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
聽
馃
AI
聽
Content type:
Code
github.com
路
6d
6 days ago
路
Hacker News
Actions for zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
Using
Scikit-LLM
with Open-Source LLMs
聽
馃
LLMs
machinelearningmastery.com
路
5d
5 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
147th airhacks tv:
Local
LLMs, LightMetal, ZSmith Agents,
AI
Rails, Saving Tokens
聽
馃
AI
聽
Content type:
Blog
adambien.blog
路
9h
9 hours ago
Actions for 147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens
google/gemma-4-12B-it-qat-q4
_
0-gguf
聽
馃
AI
huggingface.co
路
4d
4 days ago
Actions for google/gemma-4-12B-it-qat-q4_0-gguf
Gemma
4 QAT models: Optimizing model compression for mobile and laptop efficiency
聽
馃
AI
聽
Content type:
News
聽
Content type:
Blog
blog.google
路
4d
4 days ago
路
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
GGUF
vs
GPTQ
vs AWQ: The Plain-English Guide to
LLM
Quantization (and Which One to Pick)
聽
馃
AI
vettedconsumer.com
路
3d
3 days ago
路
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
Apples to Apples: MLX vs.
Llama.cpp
for
Gemma
4 12B on an M1 16GB
聽
馃
AI
聽
Content type:
Blog
ziraph.com
路
4d
4 days ago
路
Hacker News
Actions for Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
The latest
Gemma
4 models use a training trick to slash their
on-device
memory footprint
聽
馃
AI
androidauthority.com
路
4d
4 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
Google
Gemma4
12B released
聽
馃
AI
聽
Content type:
Blog
medium.com
路
5d
5 days ago
Actions for Google Gemma4 12B released
Google鈥檚 new Mac app keeps your
AI
chats off the internet
聽
馃崕
Apple
cultofmac.com
路
6d
6 days ago
Actions for Google鈥檚 new Mac app keeps your AI chats off the internet
Creating ADK Agent using
locally
running
Gemma
4
聽
馃悕
Python
聽
Content type:
Blog
medium.com
路
3d
3 days ago
Actions for Creating ADK Agent using locally running Gemma 4
docs: document lmstudio runtime contracts 路 openclaw/openclaw@82710b4
聽
馃攲
LSP Protocol
聽
Content type:
Code
github.com
路
5d
5 days ago
Actions for docs: document lmstudio runtime contracts 路 openclaw/openclaw@82710b4
alexziskind1/model-shelf: Model Shelf is a
local-first
model resolver that helps
AI
agents and scripts find model weights on your own storage before downloading from Hugging Face. Point it at an internal SSD, NAS, external SSD, or Thunderbolt DAS, and it returns the best
local
path for
GGUF
, MLX, safetensors, Ollama, vLLM, and other
local
AI
workflows.
聽
馃
AI
聽
Content type:
Code
github.com
路
5d
5 days ago
Actions for alexziskind1/model-shelf: Model Shelf is a local-first model resolver that helps AI agents and scripts find model weights on your own storage before downloading from Hugging Face. Point it at an internal SSD, NAS, external SSD, or Thunderbolt DAS, and it returns the best local path for GGUF, MLX, safetensors, Ollama, vLLM, and other local AI workflows.
Google鈥檚 latest
on-device
AI
model is custom-made for your laptop
聽
馃
AI
androidauthority.com
路
6d
6 days ago
Actions for Google鈥檚 latest on-device AI model is custom-made for your laptop
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help