🕯️ Candle

Rust ML Framework, CUDA Bindings, Model Inference, Neural Networks

I built an LLM from Scratch in Rust (Just ndarray and rand)
github.com·6h·
Discuss: r/rust
🧠LLM Inference
The pirate-based logic of Rust shared references
ais523.me.uk·4h
🦀Rust Compiler Internals
Disaggregated Inference at Scale with PyTorch and VLLM
pytorch.org·18h·
Discuss: Hacker News
🧠LLM Inference
A Dumb Introduction to z3. Exploring the world of constraint solvers with very simple examples.
asibahi.github.io·1h·
Discuss: r/programming, r/rust
🧮SMT Solvers
original ↗
blog.djnavarro.net·22h
📑Inverted Indexes
vLLM on consumer grade Blackwell with NVFP4 models - anyone actually managed to run these?
reddit.com·9h·
Discuss: r/LocalLLaMA
📊Model Serving Economics
🔗 Setting up Go templ with Tailwind, HTMX and Docker
yellowduck.be·14h
📘Typescript
Comparing transitive dependency version resolution in Rust and Java
blog.frankel.ch·3h·
Discuss: r/rust
🦀Rust
How to Train an LLM-Recommender Hybrid that Speaks English & Item IDs
eugeneyan.com·22h
🕸️Sparse Vectors
[CS 2881r] Some Generalizations of Emergent Misalignment
lesswrong.com·6h
🪄Prompt Engineering
Pursuing a Trick a Long Way Just to See Where It Goes, with Simon Peyton Jones
popovit.ch·3h·
Discuss: Hacker News
💻Programming languages
LLM Rerankers for RAG: A Practical Guide
fin.ai·1h·
Discuss: Hacker News
🏆Ranking
Gambit: An efficient implementation of the Scheme programming language
github.com·21h·
Discuss: Hacker News
🌿Leptos
How Quantized Models Are Making AI Faster on Mobile
lktechacademy.com·8h·
Discuss: r/LocalLLaMA
🧠LLM Inference
Test state, not interactions
rednafi.com·22h·
Discuss: Hacker News
🪄Prompt Engineering
Generating Consistent Illustrations with Gemini Image Generation
tinystruggles.com·14h·
Discuss: Hacker News
🪄Prompt Engineering
Is a new AI paradigm based on raw electromagnetic waves feasible?
news.ycombinator.com·20h·
Discuss: Hacker News
🔍AI Interpretability
Reaching Across the Isles: UK-LLM Brings AI to UK Languages With NVIDIA Nemotron
blogs.nvidia.com·21h
🤖AI
how fast is go? simulating millions of particles on a smart tv
dgerrells.com·22h·
Discuss: Hacker News, r/golang
🏊Memory Pools
Fil's C Compiler
fil-c.org·21h·
Discuss: Hacker News
🦀Rust Compiler Internals