Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
AI
🤖 AI
Broad
Claude, Llama, Local LLMs
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
28
posts in
11.0
ms
local
llm
on laptop 780M GPU using
llama
+ gemma 4 qat
🤖
Transformers
Content type:
Blog
alper.bearblog.dev
·
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
Here's a
llama.cpp
CLI Command builder.
🤖
Transformers
llamabuilding.com
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Here's a llama.cpp CLI Command builder.
DiffusionGemma: The Developer Guide- Google Developers Blog
🤖
Machine Learning
Content type:
Blog
developers.googleblog.com
·
20h
20 hours ago
·
r/LocalLLaMA
Actions for DiffusionGemma: The Developer Guide- Google Developers Blog
DiffusionGemma: 4x Faster Text
Generation
🤖
Machine Learning
Content type:
News
Content type:
Blog
blog.google
·
4h
4 hours ago
·
Hacker News
,
r/LocalLLaMA
,
r/singularity
Actions for DiffusionGemma: 4x Faster Text Generation
bigattichouse/packed-twin-inference
: PTI achieves ~2× throughput using a single
quantized
model (Q5_K_M or better) by running 4
generation
streams in one batched decode call. The GPU loads model weights once per step and produces 4 predictions simultaneously. KV cache overhead is ~0.8 GiB total for all 4 streams. No draft model. No quality loss
🤖
Transformers
Content type:
Code
github.com
·
1d
1 day ago
·
r/LocalLLaMA
Actions for bigattichouse/packed-twin-inference: PTI achieves ~2× throughput using a single quantized model (Q5_K_M or better) by running 4 generation streams in one batched decode call. The GPU loads model weights once per step and produces 4 predictions simultaneously. KV cache overhead is ~0.8 GiB total for all 4 streams. No draft model. No quality loss
Machinic Psychopharmacology: Do
LLMs
Self-Medicate?
🚀
Model Serving
lesswrong.com
·
6h
6 hours ago
·
Hacker News
Actions for Machinic Psychopharmacology: Do LLMs Self-Medicate?
MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
🚀
Model Serving
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
4d
4 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
Qwen 3.6 27B AutoRound GGUF, need your feedback
🤖
Transformers
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
1-bit and 1.58 bit
LLM
Benchmarking on Jetson Orin Nano Super | Bonsai LM
🧠
Deep Learning
smolhub.com
·
2d
2 days ago
·
r/LocalLLaMA
Actions for 1-bit and 1.58 bit LLM Benchmarking on Jetson Orin Nano Super | Bonsai LM
Youssof Altoukhi (@Youssofal_)
🚀
Model Serving
xcancel.com
·
3d
3 days ago
·
r/LocalLLaMA
Actions for Youssof Altoukhi (@Youssofal_)
Homebrew, Again
🛠️
Feature Engineering
Content type:
Blog
jerryz.bearblog.dev
·
2d
2 days ago
Actions for Homebrew, Again
A drop-in replacement chat template for google/gemma-4-31B-it tuned for open-source agentic coding harnesses.
🐍
Programming
gist.github.com
·
5d
5 days ago
·
r/LocalLLaMA
Actions for A drop-in replacement chat template for google/gemma-4-31B-it tuned for open-source agentic coding harnesses.
Revisiting GSM-Symbolic: Do 2026 Frontier Models Still Fail at Confounded Grade School Math?
🦙
Claude
lesswrong.com
·
4d
4 days ago
Actions for Revisiting GSM-Symbolic: Do 2026 Frontier Models Still Fail at Confounded Grade School Math?
Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 ·
ggml-org/llama.cpp
🦙
Claude
Content type:
Code
github.com
·
2h
2 hours ago
·
r/LocalLLaMA
Actions for Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 · ggml-org/llama.cpp
google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
🚀
Model Serving
huggingface.co
·
2d
2 days ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
Can activation verbalizers surface an internal chain of thought?
🤖
Transformers
lesswrong.com
·
3d
3 days ago
Actions for Can activation verbalizers surface an internal chain of thought?
How to reduce capability degradation from off-model SFT
🤖
Machine Learning
lesswrong.com
·
2d
2 days ago
Actions for How to reduce capability degradation from off-model SFT
A handy
llama-server
launcher with easy model and configuration customisation
🤖
Transformers
Content type:
Code
github.com
·
3d
3 days ago
·
r/LocalLLaMA
Actions for A handy llama-server launcher with easy model and configuration customisation
OpenEnv is now owned by HF, Torch, Prime Intellect, Unsloth, Modal, Mercor, and more! Use it for training agents.
🤖
Machine Learning
Content type:
Blog
huggingface.co
·
2d
2 days ago
·
Hacker News
,
r/LocalLLaMA
Actions for OpenEnv is now owned by HF, Torch, Prime Intellect, Unsloth, Modal, Mercor, and more! Use it for training agents.
Defeating Introspection Adapters (and Why Threat Models Matter)
🤖
Machine Learning
lesswrong.com
·
6d
6 days ago
Actions for Defeating Introspection Adapters (and Why Threat Models Matter)
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help