768GB of cheap Intel Optane DIMM memory sticks used to run 1-trillion-parameter LLM on a system with a single GPU — local Kimi K2.5 install achieved roughly 4 tokens per second (opens in new tab)

Everything pertaining to the technological singularity and related topics, e.g. AI, human enhancement, etc.