⚙️ AI Infrastructure - moznotes

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

🔧MLOps Blog

wowhow.cloud··DEV

Five labs, five minds: building a multi-model finance drama on small models

🤖AI Blog

huggingface.co·

Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script

🧠LLM Engineering Code

github.com··Hacker News

#068 - Apple runs Siri on Google's Gemini, OpenAI files a secret IPO at $852B, Xiaomi clocks 1,000 tps

🍎Apple

indiehacker.news·

How the AI Computing Paradigm Is Deconstructing Internet Governance

🧠LLM Engineering

circleid.com·

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

🤖AI

vettedconsumer.com··Hacker News

not much happened today | AINews

🤖AI

news.smol.ai·

Google Gemma4 12B released

🤖AI Blog

medium.com·

Piper: A Programmable Distributed Training System

🔧MLOps Academic

arxiv.org·

[AINews] FrontierCode: Benchmarking for Code Quality over Slop

🤖AI News

latent.space

The data center construction boom has entered a new chapter

💡Cost Optimization News

consultancy-me.com·

Integrate OpenShift AI and PG Airman MCP Server

🧠LLM Engineering

developers.redhat.com·

Youssof Altoukhi (@Youssofal_)

🧠LLM Engineering

xcancel.com··r/LocalLLaMA

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

🤖AI News Blog

blog.google··Hacker News

huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

🧠LLM Engineering Code

github.com··Hacker News

RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference

🧠LLM Engineering Academic

arxiv.org·

Florian Brand, Prime Intellect research engineer, adopts Gemma 4 E4B 6-bit quantized as his primary local Mac LLM

🧠LLM Engineering News

digg.com··Hacker News

Issue #390 - The ML Engineer 🤖

🤖AI News Blog

machinelearning.substack.com··Substack

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

Build a Medical Report Analyzer on Dedicated Inference with Python

Anthropic: Claude Now Writes 80% of Its Own Code in 2026

Five labs, five minds: building a multi-model finance drama on small models

Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script

#068 - Apple runs Siri on Google's Gemini, OpenAI files a secret IPO at $852B, Xiaomi clocks 1,000 tps

How the AI Computing Paradigm Is Deconstructing Internet Governance

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

not much happened today | AINews

Google Gemma4 12B released

Piper: A Programmable Distributed Training System

[AINews] FrontierCode: Benchmarking for Code Quality over Slop

The data center construction boom has entered a new chapter

Integrate OpenShift AI and PG Airman MCP Server

Youssof Altoukhi (@Youssofal_)

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference

Florian Brand, Prime Intellect research engineer, adopts Gemma 4 E4B 6-bit quantized as his primary local Mac LLM

Issue #390 - The ML Engineer 🤖