Local LLMs

Feeds to Scour
SubscribedAll
Scoured 440 posts in 4.4 ms

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

聽馃煝NVIDIA
everylocalai.com路路DEV

Improved performance and model support with GGUF

聽馃Open Source AI 聽Content type: Blog
ollama.com路

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

聽馃Open Source AI
alternativeto.net路

fix(opencode-go): add qwen plus tiered pricing (#91351)

聽馃捇Code Generation 聽Content type: Code
github.com
路

Qwen 3.6 27B AutoRound GGUF, need your feedback

聽馃LLMs
huggingface.co路路r/LocalLLaMA

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

聽馃Open Source AI
deemwar-products.github.io路路Hacker News

What Ollama Reveals About Local AI, Agents, and Open Models

聽馃Open Source AI 聽Content type: Blog
odsc.medium.com路

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

聽馃Open Source AI 聽Content type: Academic
arxiv.org路

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

聽馃Open Source AI 聽Content type: News 聽Content type: Tutorial
zdnet.com路

Using Scikit-LLM with Open-Source LLMs

聽馃Open Source AI
machinelearningmastery.com路

lightmetal: GPU LLM Inference From a Single Java 25 JAR

聽馃Open Source AI 聽Content type: Blog
adambien.blog路

The biggest local LLM on your machine is useless if it can't call a single tool, no matter how many parameters it has

聽馃Open Source AI
xda-developers.com路

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

聽馃LLMs
vettedconsumer.com路路Hacker News

Fixing a stuck Ollama runner and building a GPU watchdog

聽馃Open Source AI
patrickmccanna.net路路Hacker News

local llm on laptop 780M GPU using llama + gemma 4 qat

聽馃Open Source AI 聽Content type: Blog
alper.bearblog.dev路

Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell

聽馃煝NVIDIA 聽Content type: News 聽Content type: Blog
developer.nvidia.com路
Less-relevant results

An LLM that reviews your code, challenges your decisions, but never writes code for you

聽馃Open Source AI 聽Content type: Blog
blog.adafruit.com路

Unsloth Gemma 4 QAT

聽馃Open Source AI
unsloth.ai路

Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM

聽馃Open Source AI
everylocalai.com路路DEV

Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings

聽馃Open Source AI
posts.inthecyber.com路

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help