Local AI

Feeds to Scour
SubscribedAll
Scoured 371 posts in 7.2 ms

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

 🛠️Developer Tooling

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

 🤖AI Agents  Content type: Blog
adambien.blog·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 AI Hardware
alternativeto.net·

martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by local LLMs. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.

 ☁️Cloud Infrastructure  Content type: Code
github.com··Hacker News

A system programmer’s guide to LLM inference

 🧠LLMs  Content type: Blog

Using Scikit-LLM with Open-Source LLMs

 📊Data Science

LLM Routing: From Strategy Selection to Production Architecture

 ⚙️AI Automation  Content type: Blog
blog.n8n.io·

On-device AI is a margin decision

 💾ARM  Content type: Blog
ziraph.com··Hacker News

You don't need Copilot for code completion, try this instead

 🔌APIs

Improved performance and model support with GGUF

 💾ARM  Content type: Blog
ollama.com·

Qwen 3.6 27B AutoRound GGUF, need your feedback

 🧠LLMs

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

 🛡️AI Safety  Content type: Academic
arxiv.org·

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

 🤖AI Agents  Content type: News  Content type: Tutorial
zdnet.com·

local llm on laptop 780M GPU using llama + gemma 4 qat

 ⚙️LLM Fine-tuning  Content type: Blog
alper.bearblog.dev·

I added this open-source tool to my local AI stack, and my local LLM finally has persistent memory

 ✍️Prompt Engineering
xda-developers.com·

Fixing a stuck Ollama runner and building a GPU watchdog

 🖥️Self-Hosting

Unsloth Gemma 4 QAT

 🪟Windows
unsloth.ai·

Token4Token — pay-per-token inference on Gnosis + Swarm

 ☁️Cloud Infrastructure

Using local LLMs for agentic coding

 ⚙️LLM Fine-tuning  Content type: Blog
blog.alexewerlof.com·

"AI" Is Eating Platform Monopolist Free Cash Flow, Not the World: CHART OF THE DAY

 💻AI Coding  Content type: News  Content type: Blog

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help