Shypd.aiThe largest open index of AI toolsAwesome-LLM-Eval is an Academic Research tool that provides a curated list of resources for evaluating Large Language Models. It includes tools, datasets, benchmarks, demos, leaderboards, papers, and models to explore the boundaries of Generative AI.
Trending
About
Awesome-LLM-Eval is a comprehensive, curated list designed for the evaluation of Large Language Models (LLMs) and the exploration of Generative AI's capabilities and limitations. This open-source GitHub project compiles a wide array of resources, including evaluation tools, diverse datasets and benchmarks, practical demos, competitive leaderboards, relevant academic papers, and various LLM models. It serves as an official project for the survey "Beyond Benchmark: LLMs Evaluation with an Anthropomorphic and Value-oriented Roadmap," offering continuous updates that may not be reflected in the arXiv paper. The repository is actively maintained, welcoming community contributions through pull requests and issues, ensuring it remains a dynamic and up-to-date resource for researchers and developers in the LLM evaluation space.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
