Back to tyler's feed

🦙Local LLM GitHub

GitHub - vllm-project/semantic-router: Intelligent Router for Mixture-of-Models (opens in new tab)

Covered by 3 sources including Red Hat Developer, digitalocean.com

Intelligent Router for Mixture-of-Models. Contribute to vllm-project/semantic-router development by creating an account on GitHub.

Read the original article

Sign in to keep reading the full article.

Covered in 3 articles

Red Hat Developer·

Improve vLLM Semantic Router accuracy with fine-tuning

digitalocean.com·

Multi-Model API Cost Governance with the Inference Router

Session-Aware Agentic Routing: Continuity-Aware Model Selection for Long-Horizon LLM Agents

Discussed on Hacker News