🤖 AI - tionis

🧱data structures News Blog

kaitchup.substack.com··r/LocalLLaMA

I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)

🐧unix Code

github.com··r/LocalLLaMA

Running Two LLMs on a Mini PC Sounds Great Until the Benchmarks Arrive

🧱data structures

hackernoon.com·

DeskDash - a free Windows tool to easily manage your GGUF files

🕸️graphs

gerry7.itch.io··r/LocalLLaMA

Here's a llama.cpp CLI Command builder.

🐧unix

llamabuilding.com··r/LocalLLaMA

Launch HN: General Instinct (YC P26) – Frontier models on edge devices

🧩lisp Discussion

news.ycombinator.com··Hacker News

Initial impressions of Claude Fable 5

🧩lisp

simonwillison.net··Hacker News

1-bit and 1.58 bit LLM Benchmarking on Jetson Orin Nano Super | Bonsai LM

🧱data structures

smolhub.com··r/LocalLLaMA

Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 · ggml-org/llama.cpp

🐧unix Code

github.com··r/LocalLLaMA

Evaluating bigaspv2-5, a Flow Matching Alternative to SDXL

🧱data structures

hackernoon.com·

bigattichouse/packed-twin-inference: PTI achieves ~2× throughput using a single quantized model (Q5_K_M or better) by running 4 generation streams in one batched decode call. The GPU loads model weights once per step and produces 4 predictions simultaneously. KV cache overhead is ~0.8 GiB total for all 4 streams. No draft model. No quality loss

🧱data structures Code

github.com··r/LocalLLaMA

Does anyone know what PCIe mode was used for these benchmarks?

🧱data structures Code

github.com··r/LocalLLaMA

mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp

🧱data structures Code

github.com··r/LocalLLaMA

[PoC] server: support requantizing kv cache by wadealexc · Pull Request #24134 · ggml-org/llama.cpp

🧱data structures Code

github.com··r/LocalLLaMA

mtmd : add video input support by ngxson · Pull Request #24269 · ggml-org/llama.cpp

🐧unix Code

github.com··r/LocalLLaMA

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org llama.cpp · Discussion #24102

🧩lisp Discussion Code

github.com··r/LocalLLaMA

model: Granite4 Vision by gabe-l-hart · Pull Request #23545 · ggml-org/llama.cpp

🧱data structures Code

github.com··r/LocalLLaMA

No more posts from tionis's subscribed feeds.

Scour all 25258 feeds Learn more about Feeds

Qwen 3.6 27B AutoRound GGUF, need your feedback

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)

Running Two LLMs on a Mini PC Sounds Great Until the Benchmarks Arrive

DeskDash - a free Windows tool to easily manage your GGUF files

Here's a llama.cpp CLI Command builder.

Launch HN: General Instinct (YC P26) – Frontier models on edge devices

Initial impressions of Claude Fable 5

1-bit and 1.58 bit LLM Benchmarking on Jetson Orin Nano Super | Bonsai LM

Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 · ggml-org/llama.cpp

Evaluating bigaspv2-5, a Flow Matching Alternative to SDXL

Does anyone know what PCIe mode was used for these benchmarks?

mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp

[PoC] server: support requantizing kv cache by wadealexc · Pull Request #24134 · ggml-org/llama.cpp

mtmd : add video input support by ngxson · Pull Request #24269 · ggml-org/llama.cpp

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org llama.cpp · Discussion #24102

model: Granite4 Vision by gabe-l-hart · Pull Request #23545 · ggml-org/llama.cpp