⚡ LLM Optimization - jimman

🤖AI Code

github.com··Hacker News

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

⚡Model Efficiency Code

github.com··Hacker News, r/LLM

princezuda/-RequiemGPT-: Fully open source and open weights built and trained by fable five with one prompt. An experience in how AI actually works

🤖AI Code

github.com··Hacker News

Show HN: Magenta Real-Time Music Generation on iPhone, Without the GPU

🤖AI Code

github.com··Hacker News

KJLdefeated/RL.cu: RLVR training for LLM in CUDA/C++

🤖AI Code

github.com··Hacker News

apple/coreai-models: Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

🤖AI Code

github.com··Hacker News

mirkolenz/llmhop: Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies

⚡Model Efficiency Code

github.com··Hacker News

TjWheeler/deep-memory: A GraphRAG implementation with a Vocabulary system to optimise AI integration

✍️Prompt Engineering Code

github.com··Hacker News

JeevanJoshi2061/titan_engine_core: Constant-memory sequence modeling engine combining selective holographic-compression (ASH-C) with a coordinate pointer network (HEP-DNA). Bypasses the linear KV Cache bottleneck on consumer GPUs.

⚡Model Efficiency Code

github.com··Hacker News

chipmates/agoracosmica: A Living Library You Can Talk To. Open-source educational platform with 30 historical figures from philosophy, science, art, mysticism, and activism. Stories, dialogues, AI conversation, multi-figure councils. Nonprofit, BYOK, self-hostable, no behavioral tracking.

🔓Open Source Code

github.com··Hacker News

Shrivastava-Aditya/boolean-algebra-engine: Deterministic boolean algebra engine — evaluates expressions, detects contradictions, audits logic rules. MCP server, NL layer, REST API, CLI, Streamlit UI.

✍️Prompt Engineering Code

github.com··Hacker News, r/LLM

sk8erboi17/DStudio: Run DeepSeek V4 fully local: chat, a coding agent, and a design studio in one private desktop app.

✍️Prompt Engineering Code

github.com··Hacker News

mingusb/transformer-golf: The Fully Unrolled Transformer: An experimental repository for architecture simplification and compilation. [2026]

🤖AI Code

github.com··Hacker News

Show HN: TuringLLM – a LLM-powered Universal Turing machine

✍️Prompt Engineering Code

github.com··Hacker News

ninoxAI/nightwatch: Open-source, local-first, read-only AI SRE: clusters alert storms, investigates root cause over your live systems, proposes human-gated fixes.

📊Data Visualization Code

github.com··Hacker News

Show HN: CLI for scoring OpenAPI for LLM legibility

🤖AI Code

github.com··Hacker News

No more posts from jimman's subscribed feeds.

Scour all 25258 feeds Learn more about Feeds

NVIDIA and LG Group Build an AI Factory to Advance Physical AI, Mobility and AI Infrastructure

linzhiqiu/t2v_metrics: Evaluating text-to-image/video/3D models with VQAScore

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

princezuda/-RequiemGPT-: Fully open source and open weights built and trained by fable five with one prompt. An experience in how AI actually works

Show HN: Magenta Real-Time Music Generation on iPhone, Without the GPU

KJLdefeated/RL.cu: RLVR training for LLM in CUDA/C++

apple/coreai-models: Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

mirkolenz/llmhop: Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies

TjWheeler/deep-memory: A GraphRAG implementation with a Vocabulary system to optimise AI integration

JeevanJoshi2061/titan_engine_core: Constant-memory sequence modeling engine combining selective holographic-compression (ASH-C) with a coordinate pointer network (HEP-DNA). Bypasses the linear KV Cache bottleneck on consumer GPUs.

chipmates/agoracosmica: A Living Library You Can Talk To. Open-source educational platform with 30 historical figures from philosophy, science, art, mysticism, and activism. Stories, dialogues, AI conversation, multi-figure councils. Nonprofit, BYOK, self-hostable, no behavioral tracking.

Shrivastava-Aditya/boolean-algebra-engine: Deterministic boolean algebra engine — evaluates expressions, detects contradictions, audits logic rules. MCP server, NL layer, REST API, CLI, Streamlit UI.

sk8erboi17/DStudio: Run DeepSeek V4 fully local: chat, a coding agent, and a design studio in one private desktop app.

mingusb/transformer-golf: The Fully Unrolled Transformer: An experimental repository for architecture simplification and compilation. [2026]

Show HN: TuringLLM – a LLM-powered Universal Turing machine

ninoxAI/nightwatch: Open-source, local-first, read-only AI SRE: clusters alert storms, investigates root cause over your live systems, proposes human-gated fixes.

Show HN: CLI for scoring OpenAPI for LLM legibility