FastChat AI

Open platform for training, evaluating, and serving LLM-based chatbots

AI Infrastructure & MLOpsFree

FastChat is an open-source platform for training, serving, and evaluating large language model-based chatbots, developed by the LMSYS organization at UC Berkeley. It includes training code for fine-tuning LLMs using conversation data, a distributed model serving system, and Chatbot Arena, a crowdsourced evaluation platform where human raters compare models side-by-side. FastChat has enabled important research into LLM evaluation methodology. AI researchers, ML engineers building chat systems, and the LLM evaluation community use FastChat for model development and comparative assessment.

Key Features

• ✓LLM fine-tuning
• ✓Distributed serving
• ✓Chatbot Arena
• ✓Human evaluation
• ✓Open-source