Open Source AI

Feeds to Scour
SubscribedAll
Scoured 551 posts in 8.6 ms

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

馃挰LLMsContent type: Code
github.comHacker News

lightmetal: GPU LLM Inference From a Single Java 25 JAR

馃挰LLMsContent type: Blog
adambien.blog

Qwen 3.6 27B AutoRound GGUF, need your feedback

鈿欙笍ML Engineering
huggingface.cor/LocalLLaMA

NVIDIA Accelerates Google DeepMind鈥檚 DiffusionGemma for Local AI

馃aiContent type: Blog
blogs.nvidia.com

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

馃aiContent type: Academic
arxiv.org

Using Scikit-LLM with Open-Source LLMs

馃挰LLMs

AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support

鈿欙笍ML Engineering
phoronix.com

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

馃挰LLMs
alternativeto.net

The biggest local LLM on your machine is useless if it can't call a single tool, no matter how many parameters it has

馃挰LLMs
xda-developers.com

Improved performance and model support with GGUF

馃aiContent type: Blog
ollama.com

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn鈥檛 Be This Good

鈿欙笍ML EngineeringContent type: Blog
towardsai.net

DiffusionGemma: 4x Faster Text Generation

馃aiContent type: NewsContent type: Blog

DiffusionGemma: The Developer Guide

馃aiContent type: Blog
developers.googleblog.com

Using local LLMs for agentic coding

馃挰LLMsContent type: Blog
blog.alexewerlof.com

Google fills out the middle with the Gemma 4 12B

馃ai
jonpeddie.com

Domain-Specific Small Language Models (Manning)

馃ai
i-programmer.info

What's in the Box? A Field Guide to AI Models

馃aiContent type: Blog
iankduncan.com

Optimal Post-Training Quantization Scales and Where to Find Them

鈿欙笍ML EngineeringContent type: Academic
arxiv.org

local llm on laptop 780M GPU using llama + gemma 4 qat

馃挰LLMsContent type: Blog
alper.bearblog.dev

LeLab Is Hugging Face鈥檚 New Browser-Based GUI for the LeRobot Ecosystem

馃aiContent type: News
hackster.io

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help