Shypd.aiThe largest open index of AI toolsevalscope is an open-source framework for evaluating large models (LLM, VLM, AIGC) that provides a streamlined and customizable environment for performance benchmarking. It supports multi-modal and multi-domain evaluations with interactive reports.
Trending
About
EvalScope is a powerful and easily extensible open-source framework designed for efficient large model evaluation and performance benchmarking. Developed by the ModelScope Community, it offers a one-stop solution for developers to assess general model capabilities, conduct multi-model performance comparisons, and perform stress tests. Key features include comprehensive evaluation benchmarks like MMLU, C-Eval, and GSM8K, support for various model types including LLM, VLM, Embedding, Reranker, and AIGC, and seamless integration with multiple evaluation backends such as OpenCompass and VLMEvalKit. The framework also provides powerful tools for inference performance testing, interactive WebUI visualization for multi-dimensional model comparison, and an Arena Mode for multi-model battles. Its highly extensible architecture allows for easy addition of custom datasets, models, and evaluation metrics.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
