Intel and Weizmann Institute Speed AI with Speculative Decoding Advance
newsroom.intel.com·12h
🧠LLM Inference
Learning to Quantize and Precode in Massive MIMO Systems for Energy Reduction: a Graph Neural Network Approach
arxiv.org·23h
🧠LLM Inference
Rethinking Distributed Computing for the AI Era
cacm.acm.org·8h
🌐Distributed systems
Over 30 AI models have been trained at 10^25 FLOP or greater
epoch.ai·12h·
Discuss: Hacker News
📊Model Serving Economics
Parsing Protobuf Like Never Before
mcyoung.xyz·20h
💾Binary Formats
Faster, smarter, more open: Study shows new algorithms accelerate AI models
techxplore.com·10h
🏆LLM Benchmarking
Scaling Reinforcement Learning Through Memory Persistence: A Framework for Human-like Reflection…
pub.towardsai.net·17h
🆕New AI
Implementing High-Performance LLM Serving on GKE: An Inference Gateway Walkthrough
cloud.google.com·18h
🧠Inference Serving
A Wide Reduction Trick (2022)
words.filippo.io·1h·
Discuss: Lobsters, Hacker News
🌳Data Structures
Identification of functional non-coding variants associated with orofacial cleft
nature.com·14h
📇Vector Indexing
Training a Chunker with Burn
elijahpotter.dev·7h·
Discuss: Hacker News
📝Text Parsing
Good binding data is all you need
leashbio.substack.com·4h·
Discuss: Substack
🕯️Candle
STM32H735 OCTOSPI quirks
serd.es·13h
🔐Hardware Security
I Got into Deep Learning
vikas.sh·8h·
Discuss: Hacker News
🛡️AI Safety
Langevin Flows for Modeling Neural Latent Dynamics
arxiv.org·23h
🧠LLM Inference
Report: The AI Efficiency Boom
semiengineering.com·20h
📱Edge AI Optimization
Understanding Registers and Data Movement in x86-64 Assembly
blog.codingconfessions.com·15h
⚙️Mechanical Sympathy
Class-Proportional Coreset Selection for Difficulty-Separable Data
arxiv.org·23h
📊Vector Databases
Dollars per token considered harmful
modal.com·15h·
Discuss: Hacker News
📊Model Serving Economics
COLI: A Hierarchical Efficient Compressor for Large Images
arxiv.org·23h
🗜️Vector Compression