On local inference (opens in new tab)

Discussed on Hacker News

The unglamorous ongoing labor of keeping a private local inference rig running after the romance of self-hosting has worn thin.