Back to article

danmackinlay.name

Running LLMs locally on a Mac (opens in new tab)

Covers 7 stories including Ollama

Covers 7 related stories

Ollama

Discussed on Hacker News, r/LocalLLaMA, and DEV

GitHub here . You can follow the build instructions below as well. Change -DGGML_CUDA=ON to -DGGML_CUDA=OFF if you don't have a GPU or just want CPU inferen...

Discussed on r/GooglePixel, r/LocalLLaMA, r/LocalLLaMA, and DEV

Discover and run local LLMs

Discussed on Hacker News and DEV

antirez/ds4: DeepSeek 4 Flash local inference engine for Metal

Discussed on Hacker News and r/LocalLLaMA

earendil-works/pi: AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods

Jan.AI as these seem to be what most people are using, although I'm open to suggestions for other inference engines.

Discussed on r/LocalLLaMA and r/cachyos

One app. Everything yours.