Running local models is good now (opens in new tab)  🤖AI Agents  9 articles covering this post

I’ve been working since they came out, and finally, they’re surprisingly good now. I have a 2022 M2 Mac with 64 GB RAM and 1TB storage and I’ve used , as well as a number of other Qwen variants like across like raw llama.cpp with llama-cpp-python Ollama llamafiles and LM Studio Where are local models now? Early on, models were slow, hard to use, and just not that accurate for most programming tasks. The idea that local models were severely lagging behind was largely true until, for me, the re...