Shypd.aiThe largest open index of AI toolsBERTScore is an open-source Coding & Development tool that evaluates text generation using BERT embeddings. It provides precision, recall, and F1 measures for various language generation tasks.
Trending
Also listed in
About
BERTScore is an automatic evaluation metric for text generation, leveraging pre-trained contextual embeddings from BERT to compare candidate and reference sentences. It calculates precision, recall, and F1 scores based on cosine similarity, offering a robust method for assessing the quality of generated text. The tool supports approximately 130 models, with `microsoft/deberta-xlarge-mnli` currently offering the best correlation with human evaluation. It is compatible with Huggingface's transformers library and provides both a Python function and a command-line interface for ease of use. BERTScore also supports multiple reference sentences and offers options for rescaling scores with baselines and using inverse document frequency (idf) for weighted word importance.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
