Shypd.aiThe largest open index of AI toolsLLMRouter is an open-source library for LLM routing that optimizes inference by dynamically selecting the most suitable model for each query. It supports over 16 routing models and offers a unified CLI for training and inference.
Trending
Also listed in
About
LLMRouter is an intelligent open-source library designed to optimize Large Language Model (LLM) inference by dynamically selecting the most suitable model for each query. It achieves smart routing based on task complexity, cost, and performance requirements. The library supports over 16 routing models, categorized into single-round, multi-round, agentic, and personalized routers, covering diverse strategies like KNN, SVM, MLP, and graph-based routing. It provides a unified command-line interface (CLI) for training, inference, and interactive chat with a Gradio-based UI. Additionally, LLMRouter includes a comprehensive data generation pipeline for creating training data from 11 benchmark datasets, complete with automatic API calling and evaluation. It also supports multimodal understanding (image/audio/video) and integration with OpenAI-compatible servers like OpenClaw for production deployment.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
