I’m impressed with what Apple has come up with their most advanced on-device model. From <a href="https://machinelearning.apple.com/research/introducin... (opens in new tab)

I’m impressed with what Apple has come up with their most advanced on-device model. From : Built on cutting-edge Apple research, this 20-billion-parameter model uses a sparse architecture, activating just 1 to 4 billion parameters at a time depending on the request.