Open Source AI

Feeds to Scour
SubscribedAll
Scoured 584 posts in 7.9 ms

Improved performance and model support with GGUF

 Inference  Content type: Blog
ollama.com·

lightmetal: GPU LLM Inference From a Single Java 25 JAR

 🧠LLMs  Content type: Blog
adambien.blog·

Neo-X7/Neo-AI: A fully offline AI assistant powered by Ollama. Stores and retrieves conversations using SQLite + LanceDB vector search. No cloud. No API keys. Runs entirely on your machine.

 Inference  Content type: Code
github.com··DEV

LeLab Is Hugging Face’s New Browser-Based GUI for the LeRobot Ecosystem

 🏆SOTA Models  Content type: News
hackster.io·

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

 🏆SOTA Models
alternativeto.net·

Using Scikit-LLM with Open-Source LLMs

 🧠LLMs

Google releases Gemma 4 12B with encoder-free multimodal architecture

 📐Context Engineering
4sysops.com·

You don't need Copilot for code completion, try this instead

 🔧Tool Use

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

 🎼Agent Orchestration

NexusOS v2.0 – A zero-dependency pipeline streaming server chaos to Parquet

 📐Context Engineering

Fixing a stuck Ollama runner and building a GPU watchdog

 🎛️Fine-tuning

local llm on laptop 780M GPU using llama + gemma 4 qat

 👨‍💻Coding Agents  Content type: Blog
alper.bearblog.dev·

magenta/magenta-realtime: Magenta RealTime 2: An Open-Weights Live Music Model

 🎛️Fine-tuning  Content type: Code
github.com·

Why agentic AI needs an open inference stack

 🤖AI Agents
redhat.com·

Using local LLMs for agentic coding

 🧠LLMs  Content type: Blog
blog.alexewerlof.com·

Token4Token — pay-per-token inference on Gnosis + Swarm

 🧠LLMs

Making Local LLM Go Brrr

 🧠LLMs

Self-hosted remote access for Ollama without complicated setup

 🎛️Fine-tuning

147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens

 🧠LLMs  Content type: Blog
adambien.blog·

A system programmer’s guide to LLM inference

 🧠LLMs  Content type: Blog

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help