Inference Optimization

Feeds to Scour
SubscribedAll
Scoured 256 posts in 9.0 ms

OpenAI govt stake 🇺🇸, Google compute deal 🚀, Microsoft Scout launch 🤖

 ⚙️AI Infrastructure
tldr.tech·

How we fight GPU scarcity without compromise

 🤖LLM Inference  Content type: Blog
equixly.com··Hacker News

For Robotaxis, Safety Must Be Built In, Not Bolted On

 🔄Agentic Systems  Content type: Blog
blogs.nvidia.com·

fix(gateway): fail closed for unknown model auth · openclaw/openclaw@85343ea

 🤖LLM Inference  Content type: Code
github.com·

Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization

 👁️Multimodal LLMs  Content type: Academic
arxiv.org·

Particle: Anthropic Releases Claude Fable 5, a Guardrailed Public Version of Mythos

 ⚙️AI Infrastructure  Content type: News
particle.news·

Shrinking a Neural Network Often Makes It Smarter

 🤖LLM Inference
siliconopera.com·

Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!

 🤖LLM Inference
gizchina.com·

Create Your Own Programming Language with Rust

 🤖LLM Inference
createlang.rs··Hacker News

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 🤖LLM Inference
local-llm.utop.workers.dev··Hacker News

Google’s DiffusionGemma is 4x faster than its other Gemma models

 ⚙️AI Infrastructure
thenewstack.io·

LC-QAT: Data-Efficient 2-Bit QAT for LLMs via Linear-Constrained Vector Quantization

 🤖LLM Inference  Content type: Academic
arxiv.org·

Alduin 4B, an uncensored Vision LLm just released.

 🔍Retrieval-Augmented Generation
huggingface.co··r/StableDiffusion

Running LLM Inference on Kubernetes: What It Actually Takes

 🤖LLM Inference  Content type: Blog
fairwinds.com·

Local LLMs, Buy a GPU, and the Case for Cognitive Security

 🤖LLM Inference
briefing.forwardfuture.ai·

not much happened today | AINews

 🤖LLM Inference
news.smol.ai·

stable-diffusion.cpp/docs/quantization_and_gguf.md at master · leejet/stable-diffusion.cpp

 🤖LLM Inference  Content type: Code
github.com··r/StableDiffusion

On-device AI is a margin decision

 🤖LLM Inference  Content type: Blog
ziraph.com··Hacker News

Ardour 9.7 streamlines control surfaces, enhances MIDI editing and adds vertical scrollbar

 🔍Retrieval-Augmented Generation
alternativeto.net·

[AINews] FrontierCode: Benchmarking for Code Quality over Slop

 🤖LLM Inference  Content type: News
latent.space
·
Sign up or log in to see more results
Sign UpLogin

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help