Local LLMs

Feeds to Scour
SubscribedAll
Scoured 600 posts in 8.4 ms

Unsloth Gemma 4 QAT

 🧠Deep Learning
unsloth.ai·

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

 🧠Deep Learning  Content type: Code
github.com··Hacker News

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 🗂️Obsidian
alternativeto.net·

Qwen 3.6 27B AutoRound GGUF, need your feedback

 🚌GTFS
huggingface.co··r/LocalLLaMA

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

 🤖AI Ethics  Content type: Blog
towardsai.net·

Improved performance and model support with GGUF

 🧠Deep Learning  Content type: Blog
ollama.com·

lightmetal: GPU LLM Inference From a Single Java 25 JAR

 🧠Deep Learning  Content type: Blog
adambien.blog·

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

 🧠Deep Learning  Content type: News  Content type: Blog
blog.google··Hacker News

Google fills out the middle with the Gemma 4 12B

 🧠LLM Reasoning
jonpeddie.com·

The latest Gemma 4 models use a training trick to slash their on-device memory footprint

 🧠Deep Learning
androidauthority.com·

Integrate on-device AI models into your app using Core AI - WWDC26 - Videos

 👁️Computer Vision

local llm on laptop 780M GPU using llama + gemma 4 qat

 💾Local-first Software  Content type: Blog
alper.bearblog.dev·

Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB

 🥶Cold Start Problem  Content type: Blog
ziraph.com··Hacker News

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

 🧠Deep Learning

Google’s new Mac app keeps your AI chats off the internet

 🗂️Obsidian
cultofmac.com·

Google Gemma4 12B released

 🧠Deep Learning  Content type: Blog
medium.com·

Google makes Gemma 4 12B a local AI bet for startups

 🧠LLM Reasoning
startupfortune.com·

Gemma 4 12B: A unified, encoder-free multimodal model

 🥶Cold Start Problem  Content type: Discussion

Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss

 🥶Cold Start Problem  Content type: News
digg.com·

Using Scikit-LLM with Open-Source LLMs

 📈Data Science

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help