🤖 lm studio - gnomo

Less-relevant results

I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)

🎲Playtesting Code

github.com··r/LocalLLaMA

Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent

🧩Heuristics Blog

dnhkng.github.io·

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

🎰Procedural Generation

local-llm.utop.workers.dev··Hacker News

Quality Is Not a Safety Proxy Under Quantization

🎰Procedural Generation Academic

arxiv.org·

DeskDash - a free Windows tool to easily manage your GGUF files

🗂️Obsidian

gerry7.itch.io··r/LocalLLaMA

LM Link launches on iPhone, bringing local AI model access to iOS devices

🎲Playtesting

alternativeto.net·

Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB

🎰Procedural Generation Blog

ziraph.com··Hacker News

Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss

🦀rust News

digg.com·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

🎰Procedural Generation

alternativeto.net·

fix(memory): move local llama.cpp runtime to provider plugin · openclaw/openclaw@3137110

🦀rust Code

github.com·

Apple rebuilt its on-device AI stack at WWDC 2026

🎰Procedural Generation Blog

ziraph.com··Hacker News

Show HN: Ext-Infer

🦀rust

infer.displace.tech··Hacker News

Gemma 4 12B: A unified, encoder-free multimodal model

🎰Procedural Generation Discussion

news.ycombinator.com··Hacker News

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

🎲Playtesting Code

github.com··Hacker News

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

🎰Procedural Generation Blog

towardsai.net·

When AI builds itself 👷, AI is not a line item 📝, local LLMs for agentic coding 🤖

🎰Procedural Generation

tldr.tech·

Ideogram4 GGUF is out!

✒️Typography

huggingface.co··r/StableDiffusion

I got a Crush on this new Terminal-based AI coding tool

🎰Procedural Generation

xda-developers.com·

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)

Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

Quality Is Not a Safety Proxy Under Quantization

DeskDash - a free Windows tool to easily manage your GGUF files

LM Link launches on iPhone, bringing local AI model access to iOS devices

Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB

Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

fix(memory): move local llama.cpp runtime to provider plugin · openclaw/openclaw@3137110

Apple rebuilt its on-device AI stack at WWDC 2026

Show HN: Ext-Infer

Gemma 4 12B: A unified, encoder-free multimodal model

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

When AI builds itself 👷, AI is not a line item 📝, local LLMs for agentic coding 🤖

Ideogram4 GGUF is out!

I got a Crush on this new Terminal-based AI coding tool