Shypd.aiThe largest open index of AI toolsDeepSeek-671B-SFT-Guide is an open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B models. It provides complete code and scripts from training to inference, along with practical experiences and conclusions.
Trending
About
DeepSeek-671B-SFT-Guide offers an open-source solution for the full parameter fine-tuning of DeepSeek-V3/R1 671B models. Developed by the Institute of Automation of the Chinese Academy of Sciences and Beijing Wenge Technology Co. Ltd., this guide includes comprehensive code and scripts covering the entire process from training to inference. It also shares practical experiences, common pitfalls, and solutions encountered during model training and deployment. Key features include implemented modeling files for DeepSeek-V3/R1 training logic, support for full parameter fine-tuning using data parallelism (DeepSpeed ZeRO) and sequence parallelism, and detailed instructions for environment setup, data preparation, training, model weight conversion, and inference deployment. The guide is designed for technical users looking to fine-tune large language models efficiently.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
