LLM Serving

Feeds to Scour
SubscribedAll
Scoured 256 posts in 5.9 ms

Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script

 🖥️GPU Computing  Content type: Code
github.com··Hacker News

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

 🖥️GPU Computing
everylocalai.com··DEV

Breaking the Ice: Analyzing Cold Start Latency in vLLM

 ⚙️ML Infrastructure  Content type: Academic
arxiv.org··Hacker News

Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%

 ☁️GCP
zozo123.github.io··Hacker News

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 🖥️GPU Computing
alternativeto.net·

A visionary legacy: Andy Brown

 🕸️Distributed Systems
uk.themedialeader.com·

Speculators v0.5.0: DFlash support and online training

 ⚙️ML Infrastructure
developers.redhat.com·

I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why

 🤝AI-Assisted Coding  Content type: News  Content type: Tutorial
zdnet.com·

NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet

 📋Kueue
huggingface.co··Hacker News

Improved performance and model support with GGUF

 ⚙️ML Infrastructure  Content type: Blog
ollama.com·

Fixing a stuck Ollama runner and building a GPU watchdog

 🖥️GPU Computing
patrickmccanna.net··Hacker News

NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI

 🖥️GPU Computing  Content type: Blog
blogs.nvidia.com·

The economics of speculative decoding

 🖥️GPU Computing  Content type: Blog
fergusfinn.com··Hacker News

Using Scikit-LLM with Open-Source LLMs

 ⚙️ML Infrastructure
machinelearningmastery.com·

AI Serving Platform That Adapts to Your Model

 ⚙️ML Infrastructure  Content type: Blog
databricks.com·

PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference

 🖥️GPU Computing  Content type: Blog
medium.com
·

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

 ⚙️ML Infrastructure  Content type: News  Content type: Blog
blog.google··Hacker News
Less-relevant results

AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support

 🖥️GPU Computing
phoronix.com·

Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings

 🌐Cilium
posts.inthecyber.com·

DiffusionGemma: The Developer Guide

 💾AI Hardware  Content type: Blog
developers.googleblog.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help