Shypd.aiThe largest open index of AI toolsms-swift is an open-source framework for fine-tuning large language models (LLMs) and multimodal large models (MLLMs). It supports over 600 LLMs and 400 MLLMs with various training tasks and acceleration techniques.
Trending
Also listed in
About
ms-swift is a comprehensive, open-source framework developed by the ModelScope community, designed for fine-tuning and deploying large language models (LLMs) and multimodal large models (MLLMs). It supports over 600 text-only LLMs and 400 MLLMs, offering full-pipeline capabilities from training to inference, evaluation, quantization, and deployment. The framework integrates advanced training technologies, including Megatron parallelism (TP, PP, CP, EP) for acceleration and a rich family of GRPO reinforcement learning algorithms. ms-swift also supports various fine-tuning methods like LoRA, QLoRA, and DoRA, and provides memory optimization techniques such as Flash-Attention 2/3. It offers a Web-UI interface for simplified training, inference, evaluation, and quantization workflows, making it accessible for a wide range of users.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
