How far can decentralized training over the internet scale? (opens in new tab)

Decentralized AI training is growing fast, and while it likely won’t catch up to frontier models this decade, even narrowing the gap could have major implications for AI policy.