🤖 AI - hop1.ng.1357

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

💬NLP Blog

blog.xiangpeng.systems··Hacker News

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

🇨🇳Chinese AI Code

github.com··Hacker News

NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet

🪝eBPF

huggingface.co··Hacker News

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

🦉Qwen

local-llm.utop.workers.dev··Hacker News

DeepSeek enters the fight for token volume, Anthropic continues to dominate spend

🇨🇳Chinese AI Blog

vercel.com··Hacker News

raeudigerRaeffi/riddlerun: An open source agentic end2end testing tool for your webpages

🐳Docker Code

github.com··Hacker News, r/OpenAI

EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

✨LLMs Academic

arxiv.org·

Anthropic tops AI Arena rankings as it files for IPO

🎭Claude News Blog

liveclip.substack.com··Substack

patriceckhart/zot: Yet another coding agent harness, lightweight and written in go.

🔌Claude Plugins Code

github.com··Hacker News

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

🇨🇳Chinese AI Academic

arxiv.org·

Large companies can add a local LLM filter layer to considerably reducing their AI costs

💬NLP

umrashrf.github.io··Hacker News

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

🧠Machine Learning

vettedconsumer.com··Hacker News

Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial LLM Backends

📱Edge Computing Academic

arxiv.org·

Nvidia Nemotron 3 Ultra

✨LLMs

research.nvidia.com··Hacker News

Shrivastava-Aditya/boolean-algebra-engine: Deterministic boolean algebra engine — evaluates expressions, detects contradictions, audits logic rules. MCP server, NL layer, REST API, CLI, Streamlit UI.

🔌Claude Plugins Code

github.com··Hacker News, r/LLM

Fixing a stuck Ollama runner and building a GPU watchdog

ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models

Token4Token — pay-per-token inference on Gnosis + Swarm

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

A system programmer’s guide to LLM inference

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

DeepSeek enters the fight for token volume, Anthropic continues to dominate spend

raeudigerRaeffi/riddlerun: An open source agentic end2end testing tool for your webpages

EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

Anthropic tops AI Arena rankings as it files for IPO

patriceckhart/zot: Yet another coding agent harness, lightweight and written in go.

How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

Large companies can add a local LLM filter layer to considerably reducing their AI costs

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial LLM Backends

Nvidia Nemotron 3 Ultra

Shrivastava-Aditya/boolean-algebra-engine: Deterministic boolean algebra engine — evaluates expressions, detects contradictions, audits logic rules. MCP server, NL layer, REST API, CLI, Streamlit UI.