🦙 Local LLM - tyler · Scour

MartinCrespoC/QuantumLeap---Llama.cpp-TurboQuant: 🚀 Run any LLM on any hardware. 130% faster MoE inference with ExpertFlow + TurboQuant KV compression. Ollama-compatible API. Built on llama.cpp. 📊LLM Evals

github.com·2d·Hacker News·

joryeugene/dadbod-grip.nvim ⚡neovim

dotfyle.com·3d·

Ask HN: What is the best software IDE to program with a local LLM and GPU? 🕹Gaming

news.ycombinator.com·1d·Hacker News·

Running local models on Macs gets faster with Ollama's MLX support 📊LLM Evals

arstechnica.com·1d·Hacker News·

Ollama Now Runs Faster on Macs Thanks to Apple's MLX Framework 🍎Apple

macrumors.com·2d·Hacker News, r/apple·

Meeting copilot with live speaker labels (no bot, no cloud STT) 🎥WebRTC

migas.ai·1d·Hacker News, r/SideProject·

takeshy/obsidian-llm-hub: Obsidian plugin for AI chat, workflow automation, and semantic search — supports Gemini, OpenAI, OpenRouter, Grok, Ollama, and CLI backends 🧠AI

github.com·3d·r/ObsidianMD·

Ask HN: Is consumer AI boxes a viable idea? 🤨AI Criticism

news.ycombinator.com·5d·Hacker News·

Memoriant/dgx-spark-kv-cache-benchmark: KV cache quantization benchmarks on NVIDIA DGX Spark GB10 — three novel findings including the dequantization cliff and unified memory paradox ⚙️Performance Profiling

github.com·2d·Hacker News·

Loading more...