Shypd.aiThe largest open index of AI toolsLLamaTuner is an open-source toolkit for efficient and flexible fine-tuning of large language models (LLMs). It supports various LLMs like Llama, Qwen, and Mistral, and can fine-tune models on a single 8GB GPU.
Trending
About
LLamaTuner is an open-source, efficient, flexible, and full-featured toolkit designed for fine-tuning large language models (LLMs). It supports a wide range of models including Llama, Llama2, Llama3, Qwen, Baichuan, GLM, Falcon, and even visual language models (VLMs) like LLaVA. The toolkit is optimized for efficiency, capable of fine-tuning 7B LLMs on a single 8GB GPU and supporting multi-node fine-tuning for models exceeding 70B. It automatically dispatches high-performance operators like FlashAttention and Triton kernels to boost training throughput and is compatible with DeepSpeed for ZeRO optimization techniques. LLamaTuner offers various training algorithms such as QLoRA, LoRA, and full-parameter fine-tuning, alongside support for continuous pre-training, instruction fine-tuning, and agent fine-tuning. It also includes features for chatting with large models using pre-defined templates.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
