Open Source AI

Feeds to Scour
SubscribedAll
Scoured 738 posts in 7.6 ms

Improved performance and model support with GGUF

 🦬Emacs  Content type: Blog
ollama.com·

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

 🖥️Retro Computing
everylocalai.com··DEV

Qwen 3.6 27B AutoRound GGUF, need your feedback

 🦬Emacs

UniSVQ: 2-bit Unified Scalar-Vector Quantization

 🔌Single-Board Computers  Content type: Academic
arxiv.org·

lightmetal: GPU LLM Inference From a Single Java 25 JAR

 🦬Emacs  Content type: Blog
adambien.blog·

Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%

 🏠Self-Hosting
zozo123.github.io··Hacker News

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

 🦬Emacs  Content type: Code
github.com··Hacker News

You don't need Copilot for code completion, try this instead

 🦬Emacs

The Inference Alpha: Maximizing Frontier Models on AMD

 🖥️Retro Computing  Content type: Blog
digitalocean.com·

NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI

 🖥️Retro Computing  Content type: Blog
blogs.nvidia.com·

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

 🖧BSD

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 🖥️Retro Computing
alternativeto.net·

DiffusionGemma: The Developer Guide- Google Developers Blog

 🖥️Retro Computing  Content type: Blog

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

 Gemini Protocol  Content type: News  Content type: Tutorial
zdnet.com·

A system programmer’s guide to LLM inference

 🦬Emacs  Content type: Blog

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

 🖥️Retro Computing  Content type: News  Content type: Blog

DiffusionGemma: 4x Faster Text Generation

 🖥️Retro Computing  Content type: News  Content type: Blog

DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200

 🖧BSD  Content type: News

Google's new open model DiffusionGemma generates text from noise instead of word by word

 🔔Plan 9
the-decoder.com
·

Using Scikit-LLM with Open-Source LLMs

 🦬Emacs

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help