Open Source LLMs

Feeds to Scour
SubscribedAll
Scoured 695 posts in 9.0 ms

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

 🧠LLMs  Content type: Code
github.com··Hacker News

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

 🛠️AI Tooling
everylocalai.com··DEV

lightmetal: GPU LLM Inference From a Single Java 25 JAR

 🧠LLMs  Content type: Blog
adambien.blog·

Optimal Post-Training Quantization Scales and Where to Find Them

 🧠LLMs  Content type: Academic
arxiv.org·

Qwen 3.6 27B AutoRound GGUF, need your feedback

 🧠LLMs

Improved performance and model support with GGUF

 🛠️AI Tooling  Content type: Blog
ollama.com·

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

 🛠️AI Tooling  Content type: Blog
towardsai.net·

Google’s DiffusionGemma is 4x faster than its other Gemma models

 🧠LLMs
thenewstack.io·

Unsloth Gemma 4 QAT

 🧠LLMs
unsloth.ai·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 🛠️AI Tooling
alternativeto.net·

The biggest local LLM on your machine is useless if it can't call a single tool, no matter how many parameters it has

 ✍️Prompt Engineering
xda-developers.com·

What Ollama Reveals About Local AI, Agents, and Open Models

 🛠️AI Tooling  Content type: Blog
odsc.medium.com·

Using Scikit-LLM with Open-Source LLMs

 🛠️AI Tooling

Google fills out the middle with the Gemma 4 12B

 💡AI
jonpeddie.com·

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

 🛠️AI Tooling  Content type: News  Content type: Tutorial
zdnet.com·

AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support

 🧠LLMs
phoronix.com·

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

 🧠LLMs  Content type: News  Content type: Blog
blog.google··Hacker News

You don't need Copilot for code completion, try this instead

 Vibe Coding

local llm on laptop 780M GPU using llama + gemma 4 qat

 🧠LLMs  Content type: Blog
alper.bearblog.dev·

How Gemma Collins’ dad saved her from financial ruin & helped rake in £1.4M last year… he even lives with her & fiancé

 📚RAG  Content type: News
thesun.co.uk
·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help