Shypd.aiThe largest open index of AI toolsAgentBench is an AI Agents & Automation tool that provides a comprehensive benchmark for evaluating Large Language Models (LLMs) as agents. It includes diverse environments and tasks to assess LLM performance in various scenarios.
Trending
Also listed in
About
AgentBench is a comprehensive benchmark designed to evaluate Large Language Models (LLMs) as agents across a diverse spectrum of environments. It encompasses 8 distinct environments, including 5 newly created domains like Operating System (OS), Database (DB), Knowledge Graph (KG), Digital Card Game (DCG), and Lateral Thinking Puzzles (LTP), alongside 3 recompiled from published datasets (House-Holding, Web Shopping, Web Browsing). The platform offers both Dev and Test splits for each dataset, requiring LLMs to generate responses thousands of times for thorough evaluation. AgentBench also introduces VisualAgentBench for evaluating and training visual foundation agents based on large multimodal models (LMMs), covering embodied, GUI, and visual design environments. It supports quick setup using Docker Compose and provides benchmarking results via a leaderboard.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
