Local LLMs

Feeds to Scour
SubscribedAll
Scoured 255 posts in 14.7 ms

Improved performance and model support with GGUF

聽馃崕Apple 聽Content type: Blog
ollama.com路

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

聽馃崕Apple 聽Content type: Code
github.com路路Hacker News

A system programmer鈥檚 guide to LLM inference

聽馃攰Screen Readers 聽Content type: Blog
blog.xiangpeng.systems路路Hacker News

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

聽馃崕Apple 聽Content type: Blog
adambien.blog路

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

聽馃攰Screen Readers
alternativeto.net路

Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB

聽馃崕Apple 聽Content type: Blog
ziraph.com路路Hacker News

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

聽馃崕Apple 聽Content type: News 聽Content type: Tutorial
zdnet.com路

Fixing a stuck Ollama runner and building a GPU watchdog

聽馃彔Self-hosting
patrickmccanna.net路路Hacker News

maziyarpanahi/openmed: open-source healthcare ai

聽馃崕Apple 聽Content type: Code
github.com路

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

聽馃Akkoma
deemwar-products.github.io路路Hacker News

Qwen 3.6 27B AutoRound GGUF, need your feedback

聽馃捇macOS
huggingface.co路路r/LocalLLaMA

Run local agentic AI on the Mac using MLX [video]

聽馃捇macOS 聽Content type: Video
youtube.com路路Hacker News, Hacker News

Using Scikit-LLM with Open-Source LLMs

聽馃崕Apple
machinelearningmastery.com路

Distilling Safe LLM Systems via Soft Prompts for On Device Settings

聽馃攰Screen Readers 聽Content type: Academic
arxiv.org路

Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.

聽馃Akkoma 聽Content type: Code
github.com路路DEV

Using local LLMs for agentic coding

聽馃崕Apple 聽Content type: Blog
blog.alexewerlof.com路

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn鈥檛 Be This Good

聽馃攰Screen Readers 聽Content type: Blog
towardsai.net路

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

聽馃崕Apple
vettedconsumer.com路路Hacker News

I added this open-source tool to my local AI stack, and my local LLM finally has persistent memory

聽馃Akkoma
xda-developers.com路
Less-relevant results

I got a Crush on this new Terminal-based AI coding tool

聽馃彔Self-hosting
xda-developers.com路

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help