LLMs

Feeds to Scour
SubscribedAll
Scoured 921 posts in 8.8 ms

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

 🤖AI  Content type: Code
github.com··Hacker News

You don't need Copilot for code completion, try this instead

 🛠️Compilers

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

 🤖Inference  Content type: Academic
arxiv.org·

Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%

 🤖Inference

DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200

 🤖AI  Content type: News

[AINews] Anthropic Claude Fable 5 — Mythos but Safe, with Controversial Terms

 🏗️MLSys  Content type: News
latent.space
·

AI Paper Review: Training Language Models to Follow Instructions with Human Feedback (InstructGPT)

 🏗️MLSys
freecodecamp.org·

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

 ☁️Cloud  Content type: Blog
adambien.blog·

Comprehensive evaluation of LLM capabilities for interpretation and analysis of genome-scale metabolic models in metabolic engineering

 🏗️MLSys  Content type: Academic
biorxiv.org·

Claude Fable 5 silently degrades its own performance on frontier AI work

 🏗️MLSys  Content type: News  Content type: Blog

Anthropic's Fable 5 Silent Sabotage Mode

 🦀Rust
everettdutton.com··Hacker News

Using Scikit-LLM with Open-Source LLMs

 🏗️MLSys

2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP

 🤖Inference  Content type: Blog
dnhkng.github.io·

If Claude Fable stops helping you, you'll never know

 🏗️MLSys  Content type: Blog
jonready.com··Lobsters, Hacker News

Timing Trick Cuts Energy Used in LLM Training by Up to 14 Percent

 🤖AI  Content type: News
spectrum.ieee.org
·

google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation

 🤖Inference

Claude vs GPT-4: Which AI API Is Better for Developers? (2026)

 🛠️Compilers
kalyna.pro··DEV

Nine Things About Claude Mythos 5 That Matter If You’re Not an Enterprise Customer

 🏗️MLSys  Content type: News
thealgorithmicbridge.com·

Token4Token — pay-per-token inference on Gnosis + Swarm

 🤖Inference

Running LLM Inference on Kubernetes: What It Actually Takes

 ☁️Cloud  Content type: Blog
fairwinds.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help