Shypd.aiThe largest open index of AI toolsMIRAI is an open-source AI agent tool for evaluating LLM agents in event forecasting. It provides code and data for predicting international events with tool-use and complex reasoning.
Trending
About
MIRAI is an open-source benchmark designed for evaluating LLM agents in the temporal forecasting of international events. It emphasizes tool-use and complex reasoning capabilities, allowing agents to collect historical data and perform temporal reasoning to anticipate future event outcomes. The benchmark features an agentic environment with tools for accessing extensive databases of structured events and textual news articles, refined from the GDELT event database. MIRAI enables LLM agents to utilize different tools via a code-based interface, comprehensively evaluating their ability to autonomously source and integrate critical information, write code for domain-specific APIs, and jointly reason over diverse historical knowledge to accurately predict future events. It supports various LLM models and forecasting strategies like Direct IO, ZS-CoT, and ReAct.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
