I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built (opens in new tab)

My SBC cluster runs bigger models than a single Raspberry Pi, but the trade-offs are brutal