🧠 Local AI - c13e · Scour

local AI for Mac that pools RAM across devices over WiFi 🏠Homelab

retes.app·2d·r/SideProject

How to Choose Hardware for Running Local LLMs and Save Money ⚙️Systems Programming

madebyagents.com·3d·Hacker News

Prefetching Weights in llama.cpp 🛡️Memory Safety

am17an.bearblog.dev·2d

Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do 🤖AI Engineering

alash3al.github.io·5d·Hacker News

Lumai Launches the World’s First Optical Computing System for Real-Time, Billion-Parameter LLM Inference ⚗️BEAM Ecosystem

globenewswire.com·2d

AmSach/kvquant: Drop-in KV cache compressor for local LLM inference - Run 70B models on 8GB RAM ⚙️Systems Programming

github.com·13h·DEV

AWS reveals its own desktop AI agent to help get all your work done 🤖AI Engineering

·1d

Building a Private Karpathy-Style LLM Wiki With gbrain and gstack 🗃️PKM

blog.saeloun.com·3d

Vulnerabilities in Ollama software ☎️OTP

·1d

Anaconda Releases Desktop in Public Beta, Unifying AI Development Workflow 🤖AI Engineering

sdtimes.com·2d

[WIP] Benchmarking Local LLMs Against Coding Agent Harnesses 🤖AI Engineering

neuralnoise.com·3d·Hacker News

Quiz: ChatterBot: Build a Chatbot With Python 🔁Spaced Repetition

realpython.com·1d

Skymizer Taiwan Inc. Unveils Breakthrough Architecture Enabling Ultra-Large LLM Inference on a Single Card ⚗️BEAM Ecosystem

en.prnasia.com·3d·r/LocalLLaMA

Sources: Apple plans an AI overhaul for photo editing in iOS 27, including using on-device AI models to extend, enhance, and reframe photos (Mark Gurman/Bloombe... 🤖AI Engineering

techmeme.com·2d

DAK: Direct-Access-Enabled GPU Memory Offloading with Optimal Efficiency for LLM Inference 🗄️Datalog

You don't need an expensive GPU to run a local LLM that actually works ⚙️Systems Programming

xda-developers.com·1d

The New Linux Kernel AI Bot Uncovering Bugs Is A Local LLM On Framework Desktop + AMD Ryzen AI Max ⚙️Systems Programming

phoronix.com·4d·Hacker News, r/artificial, r/linux

For NVDA Users: releasing NVDA AI Assistant 0.7.1 🤖AI Engineering

I Asked My Local LLM to Add 23 Numbers. I Got Seven Different Wrong Answers. 🐫OCaml

viggy28.dev·5d·Hacker News

Crew with Gemma-4 in Colab ⚡Zig

gist.github.com·5d·DEV

Log in to enable infinite scrolling