LLM Inference

Feeds to Scour
SubscribedAll
Scoured 328 posts in 10.3 ms

martidu4/honey-ai: 🍯 All-in-one AI honeypot powered by local LLMs. SSH, HTTP, FTP, Telnet, SMTP, MySQL, Redis, Git, VNC, RDP — with canary tokens, tarpits, GZIP bombs, and threat intel reporting.

 🧠LLMs  Content type: Code
github.com··Hacker News

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 🤖ai
local-llm.utop.workers.dev··Hacker News

WWDC 2026: Foundation Models (& Anarlog)

 🧠LLMs
skushagra.com·

local AI agents for Cursor with pre-tuned marketplace/commu

 🧠LLMs
locaible.com··Hacker News

Here's a llama.cpp CLI Command builder.

 🧠LLMs
llamabuilding.com··r/LocalLLaMA

The hidden bottleneck in LLM inference and the impact on MLPerf benchmarking

 🧠LLMs
edn.com·

How we fight GPU scarcity without compromise

 🧠LLMs  Content type: Blog
equixly.com··Hacker News

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

 🧠LLMs  Content type: Code
github.com··Hacker News

Show HN: Ext-Infer

 🧠LLMs
infer.displace.tech··Hacker News

google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation

 🤖AI Engineering
huggingface.co··r/LocalLLaMA

OpenCV 5.0 Computer Vision Library Released with Rewritten DNN Engine

 🤖AI
linuxiac.com·

OpenCV 5 release - New DNN engine with enhanced ONNX and LLM/VLM support, Intel, Arm, and RISC-V hardware optimizations - CNX Software

 🤖AI  Content type: News
cnx-software.com·

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

 🧠LLMs  Content type: Academic
arxiv.org·

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

 🧠LLMs  Content type: Code
github.com··Hacker News

A field journal on Ray Data and Daft for multimodal data lake (14 minute read)

 🧠LLMs  Content type: Blog
mehulbatra.medium.com·

Intro — Sehastrajit

 🤖ai  Content type: Blog
medium.com·

NVIDIA Nemotron 3 Ultra

 🧠LLMs  Content type: Blog
ollama.com·

I built an open-source persistent memory layer for AI coding agents

 🧠LLMs  Content type: Code
github.com··r/GithubCopilot

Ask HN: Is software engineering still a good career choice for new students?

 🤖Machine Learning  Content type: Discussion
news.ycombinator.com··Hacker News

On-device AI is a margin decision

 🧠LLMs  Content type: Blog
ziraph.com··Hacker News
Sign up or log in to see more results
Sign UpLogin

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help