Shypd.aiThe largest open index of AI toolsPrize was a contest that sought to identify tasks where larger language models perform worse than smaller models, a phenomenon known as inverse scaling. The contest has concluded, and results are available.
Trending
About
The Inverse Scaling Prize was a contest designed to find tasks where larger language models (LLMs) exhibit inverse scaling, meaning their performance degrades as they become larger and more capable at general language modeling. The initiative aimed to highlight potential failure modes in the current paradigm of LLM pretraining and scaling, emphasizing the importance of understanding these issues for the safe and responsible use of AI. Participants were challenged to submit tasks demonstrating this counter-intuitive behavior, with significant prize money awarded to winning entries. The contest concluded with two rounds of submissions, and the organizers plan to publish a paper surveying the submitted tasks, inviting authors of winning and accepted tasks to co-author. The project also released data for all winning tasks, contributing to ongoing research in LLM behavior.
Capabilities
Pricing & Plans
Free
Free
FAQs
Trending
