FastChat
Visit ToolFastChat is an open platform for training, serving, and evaluating large language model-based chatbots. It powers Chatbot Arena, serving millions of chat requests and compiling an LLM Elo leaderboard.
At a glance
Trending
FastChat is an open platform for training, serving, and evaluating large language model-based chatbots. It powers Chatbot Arena, serving millions of chat requests and compiling an LLM Elo leaderboard.
Trending
About
FastChat provides an open platform for the entire lifecycle of large language models, from training and serving to comprehensive evaluation. It is the technology behind Chatbot Arena, a popular platform that has processed over 10 million chat requests for more than 70 LLMs and collected over 1.5 million human votes to create an online LLM Elo leaderboard. Key features include training and evaluation code for state-of-the-art models like Vicuna and MT-Bench, alongside a distributed multi-model serving system with a web UI and OpenAI-compatible RESTful APIs. FastChat supports a wide range of models and offers flexible deployment options, including single GPU, multiple GPUs, CPU-only, and specialized hardware like Apple Silicon's Metal backend and Intel XPUs.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending