Shypd.aiThe largest open index of AI toolsmteb is an open-source multimodal toolbox for evaluating embeddings and retrieval systems. It provides a massive benchmark for assessing the performance of text embeddings across various tasks, supporting both text and multilingual embeddings.
Trending
About
mteb (Massive Text Embedding Benchmark) is an open-source Python library designed for comprehensive evaluation of text and multimodal embeddings. It offers a standardized framework to benchmark the performance of different embedding models across a wide array of tasks, including classification, clustering, semantic textual similarity (STS), retrieval, and reranking. The tool supports both monolingual and multilingual evaluations, with a focus on reproducibility and ease of use. Developers and researchers can use mteb to select models, define custom models, run evaluations, and analyze results, contributing to an interactive leaderboard that tracks the state-of-the-art in embedding performance. Its modular design allows for easy integration of new models, datasets, and benchmarks.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
