LLMs

Feeds to Scour
SubscribedAll
Scoured 702 posts in 21.3 ms

A handy llama-server launcher with easy model and configuration customisation

 🧊Apache Iceberg  Content type: Code
github.com··r/LocalLLaMA

Here's a llama.cpp CLI Command builder.

 🧊Apache Iceberg

RATrain: A Resource-Aware Training Runtime for Large Language Models on Bandwidth-Constrained Heterogeneous Supercomputing Platforms

 Apache Spark  Content type: Academic
arxiv.org·

What Is Generative AI?

 🧠AI Engineering  Content type: Academic
excelsior.edu·

Melanie Mitchell: What We Get Wrong About AI

 🤖Machine Learning

How J.A.R.V.I.S. Became the Smartest Mind on Earth — What is an LLM?

 🧠AI Engineering  Content type: Blog
medium.com·

Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent

 🔁MLOps  Content type: Blog
dnhkng.github.io·

Claude vs GPT-4: Which AI API Is Better for Developers? (2026)

 🧠AI Engineering
kalyna.pro··DEV

bigattichouse/packed-twin-inference: PTI achieves ~2× throughput using a single quantized model (Q5_K_M or better) by running 4 generation streams in one batched decode call. The GPU loads model weights once per step and produces 4 predictions simultaneously. KV cache overhead is ~0.8 GiB total for all 4 streams. No draft model. No quality loss

 🔗gRPC  Content type: Code
github.com··r/LocalLLaMA

Alignment Defends LLMs from Property Inference Attacks

 🔁MLOps  Content type: Academic
arxiv.org·

Why Shrinking an AI Model Often Makes It More Useful

 🧠AI Engineering
siliconopera.com·

2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP

 🧠AI Engineering  Content type: Blog
dnhkng.github.io·

I built an open-source persistent memory layer for AI coding agents

 🔗gRPC  Content type: Code

REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs

 🔁MLOps  Content type: Academic
arxiv.org·

AI Agents Running Businesses: Andon Labs on Project Vend

 🧠AI Engineering
startuphub.ai·

I finally built the central AI hub I've been wanting, and Open WebUI made it stupidly simple

 🧠AI Engineering
xda-developers.com·

ashp15205/guardian-runtime: A zero-latency, local-first runtime firewall for LLMs. Intercept every prompt and response locally to stop data leaks and runaway token costs.

 🧠AI Engineering  Content type: Code
github.com··Hacker News

Deep Learning Weekly: Issue 458

 🤖Machine Learning

LLM-as-a-Discriminator: When Synthetic Tables Still Look Real

 🤖Machine Learning  Content type: Academic
arxiv.org·

Context Engineering vs. Prompt Engineering: Why Your AI Agent Gets Dumber the Longer It Runs

 🧠AI Engineering  Content type: Blog
medium.com
·
Sign up or log in to see more results

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help