🦙 Local LLM - tyler · Scour

What's in a GGUF, besides the weights - and what's still missing? 🔧Code Generation

nobodywho.ooo·6d·Hacker News, r/LocalLLaMA

Ollama Doesn't Know Its GPU Is on Another Machine ⚡WebGPU Compute

loopholelabs.io·15h·Hacker News

Benchmarking llama.cpp's brand-new MTP support on Strix Halo ⚙️Performance Profiling

calebcoffie.com·2d·Hacker News

GPU Memory Math for LLMs: Formula That Tells You What Fits on Your GPU 🎮WebGPU

theahmadosman.substack.com·8h·Substack, r/LocalLLaMA

Why and How to Run Local Models in Zed 📊LLM Evals

Find bugs in YOUR code using OpenCode, Llama.cpp and Qwen3.6 🐛Fuzzing

wtarreau.blogspot.com·3d·Lobsters, Hacker News, wtarreau.blogspot.com

I tried 4 LLM speedup techniques on CPU. Three made it slower. ⚙️Performance Profiling

deemwar-products.github.io·10h·Hacker News

ndom91/llama-dash: The operations layer for your local LLM stack 📊Performance Monitoring

github.com·1d·Hacker News

Self-Hosted AI for Telegram/WhatsApp/Discord via Ollama, Zero Cloud 🏠Self-Hosting

crustaidocs.netlify.app·1d·Hacker News

The Ultimate LLM Fine-Tuning Guide 📊LLM Evals

promptinjection.net·3d·Hacker News

slokam-ai/localgcp: LocalStack for GCP. One Go binary emulating 14 Google Cloud services locally: Vertex AI, BigQuery, Spanner, Firestore, Pub/Sub, Cloud Storage, Bigtable, Cloud SQL, Memorystore, Cloud Tasks, KMS, Secret Manager, Cloud Run, Cloud Logging. Zero cloud bills. ☁️Cloudflare Workers

github.com·14h·Lobsters, Hacker News

What can a local model do for you in early May 2026? 📊LLM Evals

manichord.com·2d·Hacker News

Can You Run LLMs Locally Without a GPU? I Tested 8 Models on Linux 📊LLM Evals

itsfoss.com·5d·Hacker News

Tagging my blog posts with BERTopic and LLMs 📝NLP

vickiboykis.com·3d·Hacker News

I built Mofakir: A native, local AI desktop assistant for Linux that actually interacts with your system 🐛Fuzzing

github.com·6h·r/linux

Surprising things I learned putting together a Home Brain 💬Prompt Engineering

bitworking.org·3d·Hacker News

Doorman11991/smallcode: AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model. 💬Prompt Engineering

github.com·2d·Hacker News, r/SideProject, r/vibecoding

Llama.cpp b9180: MTP support landed 🧮Memory Allocators

github.com·3d·Hacker News

2.3x KV Cache Compression at 32k Context 🧮Memory Allocators

github.com·6d·Hacker News

LocalVibe – Pure-Rust local AI stack with MCP, in one binary (Apple Silicon) 🪟Tauri

github.com·4d·Hacker News

Log in to enable infinite scrolling