⚡ Inference Optimization - SeanNg

🎯Fine-tuning News Blog

blog.google··Hacker News, r/LocalLLaMA, r/singularity

TFLite Edge Model Quantizer Snippet

🤖AI

itsevilduck.gumroad.com··DEV

Ideogram4 GGUF is out!

✨Gemini

huggingface.co··r/StableDiffusion

Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

🤖LLM Academic

arxiv.org·

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

🦙Llama Code

github.com··Hacker News

OpenCV Introduces New DNN Inference Engine

👁️Computer Vision

i-programmer.info·

OpenCV 5 Is Here: The Biggest Leap in Years for Computer Vision

👁️Computer Vision

opencv.org··Hacker News, Hacker News

Apple WWDC On-Device AI Deep Dive - Google Docs

🤖AI

gist.is··Hacker News

For Robotaxis, Safety Must Be Built In, Not Bolted On

✍️Prompt Engineering Blog

blogs.nvidia.com·

Google releases Gemma 4 QAT models for local AI on enterprise laptops

🧠OpenAI

4sysops.com·

Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design

🤖Agent Blog

tilert.ai··Hacker News

A system programmer’s guide to LLM inference

🤖LLM Blog

blog.xiangpeng.systems··Hacker News

Quality Is Not a Safety Proxy Under Quantization

🎯Fine-tuning Academic

arxiv.org·

How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops

🤖LLM Video

youtube.com·

Add in-memory patching for alignments · OHF-Voice/piper1-gpl@002729a

🔓Open Source Code

github.com·

Token4Token — pay-per-token inference on Gnosis + Swarm

🤖LLM

t4t.eth.link··Hacker News

anthonypjshaw/doom-onnx

✍️Prompt Engineering

huggingface.co··Hacker News, r/programming

China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)

🦙Llama News

decrypt.co··Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS

🪟Context Windows Blog

mimo.xiaomi.com··Hacker News, r/LocalLLaMA

Domain-Specific Small Language Models (Manning)

DiffusionGemma: 4x Faster Text Generation

TFLite Edge Model Quantizer Snippet

Ideogram4 GGUF is out!

Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

OpenCV Introduces New DNN Inference Engine

OpenCV 5 Is Here: The Biggest Leap in Years for Computer Vision

Apple WWDC On-Device AI Deep Dive - Google Docs

For Robotaxis, Safety Must Be Built In, Not Bolted On

Google releases Gemma 4 QAT models for local AI on enterprise laptops

Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design

A system programmer’s guide to LLM inference

Quality Is Not a Safety Proxy Under Quantization

How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops

Add in-memory patching for alignments · OHF-Voice/piper1-gpl@002729a

Token4Token — pay-per-token inference on Gnosis + Swarm

anthonypjshaw/doom-onnx

China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS