📊 Quantization - matmat · Scour

LoRaQ: Optimized Low Rank Approximation for 4-bit Quantization 🧠Neural Compression

Types and Neural Networks 🎯Gradual Typing

brunogavranovic.com·4d·Hacker News

Quantization robustness from dense representations of sparse functions in high-capacity kernel associative memory 🔢Binary Embeddings

On the Quantization Robustness of Diffusion Language Models in Coding Benchmarks 🧠Learned Codecs

From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization 💻Local LLMs

SparKV: Overhead-Aware KV Cache Loading for Efficient On-Device LLM Inference 💻Local LLMs

Lossless Compression via Chained Lightweight Neural Predictors with Information Inheritance 🌊Streaming Compression

Bridging the Training-Deployment Gap: Gated Encoding and Multi-Scale Refinement for Efficient Quantization-Aware Image Enhancement 🧠Learned Compression

D-QRELO: Training- and Data-Free Delta Compression for Large Language Models via Quantization and Residual Low-Rank Approximation 🧠Neural Compression

Algorithm and Hardware Co-Design for Efficient Complex-Valued Uncertainty Estimation 🔧Hardware Verification

FairyFuse: Multiplication-Free LLM Inference on CPUs via Fused Ternary Kernels 💻Local LLMs

Resource-aware Mixed-precision Quantization for Enhancing Deployability of Transformers for Time-series Forecasting on Embedded FPGAs ⚡Compression Hardware

Towards Joint Quantization and Token Pruning of Vision-Language Models 🧠Neural Compression

GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling 💻Local LLMs

Sequential KV Cache Compression via Probabilistic Language Tries: Beyond the Per-Vector Shannon Limit 🌊Streaming Compression

arxiv.org·5d·Hacker News

Silicon Aware Neural Networks 🖥️Hardware Architecture

Soft Label Pruning and Quantization for Large-Scale Dataset Distillation 💻Local LLMs

A Sugeno Integral View of Binarized Neural Network Inference 🧠Neural Compression

AQPIM: Breaking the PIM Capacity Wall for LLMs with In-Memory Activation Quantization 💻Local LLMs

RAYEN: Imposition of Hard Convex Constraints on Neural Networks 🌀Riemannian Computing

No more posts from matmat's subscribed feeds.

Scour all 24370 feeds Learn more about Feeds

Log in to enable infinite scrolling