Shypd.aiThe largest open index of AI toolslong-form-factuality is an Academic Research tool that benchmarks factuality in large language models. It includes a prompt set (LongFact) and an automatic evaluation system (SAFE) for long-form responses.
Trending
About
long-form-factuality is an open-source project from Google DeepMind designed to benchmark the factuality of large language models (LLMs) in long-form responses. The repository provides the official code for their paper "Long-form factuality in large language models." Key components include LongFact, a comprehensive prompt set of 2,280 fact-seeking prompts specifically designed for long-form responses, and the Search-Augmented Factuality Evaluator (SAFE), an automatic system for evaluating model responses. It also features F1@K, an extension of the F1 score for long-form settings, and an experimentation pipeline for benchmarking models like OpenAI and Anthropic using LongFact and SAFE. This tool is essential for researchers and developers focused on improving the factual accuracy of LLMs.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
