Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Local AI
🧠 Local AI
local models, LLM inference, Ollama, self-hosted AI
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
531
posts in
7.7
ms
zhongkaifu/TensorSharp: A C#
inference
engine
for running large language
models
(LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
🤖
AI Engineering
Content type:
Code
github.com
·
6d
6 days ago
·
Hacker News
Actions for zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
Google Shrank
Gemma
4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
🤖
AI Engineering
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
147th airhacks tv:
Local
LLMs, LightMetal, ZSmith Agents,
AI
Rails, Saving Tokens
⚙️
Compiler Design
Content type:
Blog
adambien.blog
·
16h
16 hours ago
Actions for 147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens
Inferoa
AI
harness claimed 90% cache savings. We ran it and measured 97.8%
🤖
AI Engineering
zozo123.github.io
·
8h
8 hours ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
Ollama
0.30 delivers faster NVIDIA GPU performance and wider hardware support
💧
Elixir
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Improved performance and
model
support with
GGUF
⚗️
BEAM Ecosystem
Content type:
Blog
ollama.com
·
5d
5 days ago
Actions for Improved performance and model support with GGUF
Alignment Collapse Under KV Cache
Quantization
: Diagnosis and Mitigation
🤖
AI Engineering
Content type:
Academic
arxiv.org
·
15h
15 hours ago
Actions for Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
google/gemma-4-31B-it
· fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
🤖
AI Engineering
huggingface.co
·
2d
2 days ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
Gemma
4 QAT
models
: Optimizing model compression for mobile and laptop efficiency
🤖
AI Engineering
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Google fills out the middle with the
Gemma
4 12B
🤖
AI Engineering
jonpeddie.com
·
1d
1 day ago
Actions for Google fills out the middle with the Gemma 4 12B
Unsloth
Gemma
4 QAT
🔁
Spaced Repetition
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
You don't need Copilot for code completion, try this instead
🤖
AI Engineering
mistral.ai
·
2d
2 days ago
·
r/GithubCopilot
Actions for You don't need Copilot for code completion, try this instead
Google
Gemma
4 12B brings native multimodal
AI
to standard laptops
🤖
AI Engineering
4sysops.com
·
1d
1 day ago
Actions for Google Gemma 4 12B brings native multimodal AI to standard laptops
Using
Scikit-LLM
with Open-Source LLMs
🐫
OCaml
machinelearningmastery.com
·
6d
6 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
defai-digital/ax-engine
: Apple Silicon
LLM
runtime supporting
Gemma
4 and Qwen 3.6 MTP modes
⚗️
BEAM Ecosystem
Content type:
Code
github.com
·
18h
18 hours ago
·
Hacker News
Actions for defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
How
Gemma
Collins’ dad saved her from financial ruin & helped rake in £1.4M last year… he even lives with her & fiancé
📊
Quantified Self
Content type:
News
thesun.co.uk
·
1d
1 day ago
Actions for How Gemma Collins’ dad saved her from financial ruin & helped rake in £1.4M last year… he even lives with her & fiancé
The latest
Gemma
4
models
use a training trick to slash their on-device memory footprint
🔁
Spaced Repetition
androidauthority.com
·
4d
4 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
local
llm
on laptop 780M GPU using
llama
+ gemma 4 qat
⚡
Zig
Content type:
Blog
alper.bearblog.dev
·
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
How to Run
Gemma
4 12B
Locally
- The Best
AI
For Consumer Laptops
🤖
AI Engineering
Content type:
Video
youtube.com
·
6d
6 days ago
Actions for How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops
lightmetal: GPU
LLM
Inference
From a Single Java 25 JAR
⚙️
Compiler Design
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help