AI Infrastructure

Feeds to Scour
SubscribedAll
Scoured 39 posts in 5.9 ms

Breaking the Ice: Analyzing Cold Start Latency in vLLM

 🦀Rust Systems  Content type: Academic
arxiv.org··Hacker News

Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%

 👁️Observability
zozo123.github.io··Hacker News

DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200

 🧠Machine Learning  Content type: News
newsletter.semianalysis.com
··Hacker News

DiffusionGemma: 4x Faster Text Generation

 🧠Machine Learning  Content type: News  Content type: Blog
blog.google··Hacker News, r/LocalLLaMA, r/singularity

Upstart chipmakers keep challenging Nvidia. This time it's Microsoft-backed D-Matrix

 🧠Claude  Content type: News
cnbc.com··Hacker News

Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script

 🧠Machine Learning  Content type: Code
github.com··Hacker News

Token4Token — pay-per-token inference on Gnosis + Swarm

 🪙cryptocurrency
t4t.eth.link··Hacker News

How we fight GPU scarcity without compromise

 🏗️System Design  Content type: Blog
equixly.com··Hacker News

Google reportedly orders at least three million chips from Intel to arrive in 2028, as TSMC struggles to keep up with the AI boom

 🧠AI Research  Content type: News
pcgamer.com
··Hacker News

NVIDIA and LG Group Build an AI Factory to Advance Physical AI, Mobility and AI Infrastructure

 🧠AI Research  Content type: Blog
blogs.nvidia.com··Hacker News

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

 🧠AI Research
vettedconsumer.com··Hacker News

Create Your Own Programming Language with Rust

 🦀Rust
createlang.rs··Hacker News

Magenta RealTime 2: Open and Local Live Music Models

 ✍️Prompt Engineering
magenta.withgoogle.com··Hacker News, Hacker News, r/LocalLLaMA

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 🧠Machine Learning
local-llm.utop.workers.dev··Hacker News
Less-relevant results

Machinic Psychopharmacology: Do LLMs Self-Medicate?

 ✍️Prompt Engineering
lesswrong.com··Hacker News

huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

 🎆Firecracker  Content type: Code
github.com··Hacker News

Show HN: 3D print Z reinforcement via injected loops

 🎆Firecracker
mgunlogson.github.io··Hacker News

Unpacking AI: The Hardware Behind AI

 🧠AI Research  Content type: News
pathtostaff.com··Hacker News

Five labs, five minds: building a multi-model finance drama on small models

 🧠Machine Learning  Content type: Blog
huggingface.co·

From Jupyter Notebook to production: How to ship AI systems that actually work

 🚢DevOps Automation
thenewstack.io··Hacker News

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help