📝 NLP - jyunzhang · Scour

How LLMs Actually Work: A Friendly Map for Humans • oreoro

🤖Transformers

oreoro.github.io··Hacker News

Doubling Qwen3.6-27B on One RTX 3090: ollama llama.cpp + MTP, Lever by Lever (35.7 80.2 tok/s)

🤖LLMs Blog

A retrieval conditioned rebinding circuit for dynamic entity tracking in large language models

🤖LLMs Academic

Research Proposal: Decoupled RISC-LLM Architectures via Circadian Synaptic Consolidation

🤖Machine Learning

aermia.com··Hacker News

Qwen 3.6 27B AutoRound GGUF, need your feedback

huggingface.co··r/LocalLLaMA

Auditing Training Data in Domain-adapted LLMs: LoRA-MINT

🤖LLMs Academic

Run Gemma-4 12B on WSL2 with llama.cpp

🔧Developer Tools Blog

bigattichouse/packed-twin-inference: PTI achieves ~2× throughput using a single quantized model (Q5_K_M or better) by running 4 generation streams in one batched decode call. The GPU loads model weights once per step and produces 4 predictions simultaneously. KV cache overhead is ~0.8 GiB total for all 4 streams. No draft model. No quality loss

🤖LLMs Code

github.com··r/LocalLLaMA

LangChain Series #2: Models Explained — LLMs, Chat Models, and Embeddings with Practical…

pub.towardsai.net

·

nex-agi/Nex-N2-mini • Huggingface

🤖Transformers

huggingface.co··r/LocalLLaMA

AI-Driven Test Case Generation from Natural Language Requirements: A Survey of Techniques and Research Gaps

⚡Code Generation Academic

Vector Embeddings Explained: How AI Actually Understands Meaning

🤖LLMs Blog

[PoC] server: support requantizing kv cache by wadealexc · Pull Request #24134 · ggml-org/llama.cpp

🤖LLMs Code

github.com··r/LocalLLaMA

The Model Was the Easy Part: A Practitioner’s Guide to AI Licenses

pub.towardsai.net

·

Analyzing the Correlation Between Hallucinations and Knowledge Conflicts in Large Language Models

🤖LLMs Academic

BUDDY: BUdget-Driven DYnamic Depth Routing for Adaptive Large Language Model Inference

🤖LLMs Academic

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org llama.cpp · Discussion #24102

🤖LLMs Discussion Code

github.com··r/LocalLLaMA

Can LLMs save themselves from verbosity?

🤖LLMs Blog

TrustMargin: Training-Free Arbitration between Parametric Memory and Retrieved Evidence in Large Language Models

🤖LLMs Academic

Unlocking the Power of RAG Systems with LangChain and Vector Databases

🔍RAG Blog

Log in to enable infinite scrolling