I’ve been working since they came out, and finally, they’re surprisingly good now. I have a 2022 M2 Mac with 64 GB RAM and 1TB storage and I’ve used , as well as a number of other Qwen variants like across like raw llama.cpp with llama-cpp-python Ollama llamafiles and LM Studio Where are local models now? Early on, models were slow, hard to use, and just not that accurate for most programming tasks. The idea that local models were severely lagging behind was largely true until, for me, the re... Read more ›
We’re on a journey to advance and democratize artificial intelligence through open source and open science. Read more ›
I don't know about good, I use a lot of local models and they're still pretty painful to run locally Read more ›