Local AI Needs Data-Plane Health Checks (opens in new tab)
The worst network bugs are the ones where every dashboard says green and the packet still dies. That was my Sunday. I have a Mac that I use as my daily machine and a Linux box called newtorob with a 2080 Ti in it. Potluck runs a local AI sidecar on each machine. The Mac can use its own model locally, or route a request to another machine in my household over a WireGuard mesh. The product shape is simple: Mac app -> local sidecar -> WireGuard mesh -> Linux sidecar -> model runtime -> streamed ...
Read the original article