Local AI

Feeds to Scour
SubscribedAll
Scoured 369 posts in 4.5 ms

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

 🛠️Developer Tooling

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

 AI Hardware
everylocalai.com··DEV

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

 🤖AI Agents  Content type: Blog
adambien.blog·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 AI Hardware
alternativeto.net·

I built an open-source persistent memory layer for AI coding agents

 💻AI Coding  Content type: Code

Using Scikit-LLM with Open-Source LLMs

 📊Data Science

LLM Routing: From Strategy Selection to Production Architecture

 ⚙️AI Automation  Content type: Blog
blog.n8n.io·

A system programmer’s guide to LLM inference

 🧠LLMs  Content type: Blog

On-device AI is a margin decision

 💾ARM  Content type: Blog
ziraph.com··Hacker News

Improved performance and model support with GGUF

 💾ARM  Content type: Blog
ollama.com·

You don't need Copilot for code completion, try this instead

 🔌APIs

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

 🛡️AI Safety  Content type: Academic
arxiv.org·

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

 🤖AI Agents  Content type: News  Content type: Tutorial
zdnet.com·

local llm on laptop 780M GPU using llama + gemma 4 qat

 ⚙️LLM Fine-tuning  Content type: Blog
alper.bearblog.dev·

Qwen 3.6 27B AutoRound GGUF, need your feedback

 🧠LLMs

I added this open-source tool to my local AI stack, and my local LLM finally has persistent memory

 ✍️Prompt Engineering
xda-developers.com·

Unsloth Gemma 4 QAT

 🪟Windows
unsloth.ai·

Fixing a stuck Ollama runner and building a GPU watchdog

 🖥️Self-Hosting

Using local LLMs for agentic coding

 ⚙️LLM Fine-tuning  Content type: Blog
blog.alexewerlof.com·

Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM

 AI Hardware
everylocalai.com··DEV

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help