Shypd.aiThe largest open index of AI toolsLLM-Pruner is an AI Frameworks & Infra tool that structurally prunes large language models. It supports models like Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, and TinyLlama, allowing for significant compression.
Trending
About
LLM-Pruner is a cutting-edge tool designed for the structural pruning of large language models (LLMs), as presented at NeurIPS 2023. It enables users to compress LLMs to any desired size while retaining their original multi-task solving abilities. The tool emphasizes task-agnostic compression, requiring minimal training corpus (e.g., 50k Alpaca samples for post-training) and offering efficient compression times, with pruning taking approximately 3 minutes and post-training around 3 hours. LLM-Pruner supports a wide range of popular LLMs, including Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, and TinyLlama. It features an automatic structural pruning process, aiming for minimal human effort, and provides detailed instructions for discovery, estimation, and recovery stages of pruning, along with evaluation using lm-evaluation-harness.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
