Shypd.aiThe largest open index of AI toolshallucination-leaderboard is an AI Agents & Automation tool that provides a public leaderboard comparing LLM performance in producing hallucinations when summarizing short documents. It uses Vectara's Hallucination Evaluation Model (HHEM) to assess LLM accuracy.
Trending
About
The hallucination-leaderboard is a public resource that ranks Large Language Models (LLMs) based on their ability to summarize short documents without generating hallucinations. Utilizing Vectara's proprietary Hallucination Evaluation Model (HHEM), the leaderboard quantifies the hallucination rate, factual consistency rate, and answer rate for various LLMs. This tool is regularly updated to reflect advancements in both the evaluation model and the LLMs themselves, offering a dynamic benchmark for researchers and developers. It's particularly useful for understanding LLM reliability in summarization tasks, which is critical for applications like Retrieval Augmented Generation (RAG) and agentic systems. The methodology involves prompting LLMs to summarize documents using only provided facts, with a focus on factual consistency rather than general factual accuracy.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
