Shypd.aiThe largest open index of AI toolsLongBench is an AI testing & QA tool that evaluates Large Language Models (LLMs) on their ability to handle long-context tasks. It provides a benchmark for deep understanding and reasoning across realistic multitasks.
Trending
About
LongBench is an open-source evaluation tool designed to rigorously assess the capabilities of Large Language Models (LLMs) in processing and reasoning over extensive contexts. LongBench v2, the latest iteration, features context lengths ranging from 8k to 2M words, presenting a significant challenge even for human experts. It covers six major task categories including single-document QA, multi-document QA, long in-context learning, long-dialogue history understanding, code repo understanding, and long structured data understanding. The benchmark consists of 503 challenging multiple-choice questions, ensuring reliable evaluation. Data is collected from nearly 100 highly educated individuals, undergoing both automated and manual review to maintain high quality and difficulty. LongBench aims to provide a reliable standard for developing future superhuman long-context AI systems.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
