Shypd.aiThe largest open index of AI toolsChatLM-mini-Chinese is an Open Source & Models tool that provides a 0.2B parameter Chinese dialogue model. It offers open-source code for data processing, tokenizer training, and model pre-training, supporting SFT instruction fine-tuning and RLHF optimization.
Trending
Also listed in
About
ChatLM-mini-Chinese is an open-source project featuring a 0.2B parameter Chinese dialogue model (ChatLM-Chinese-0.2B). It provides comprehensive code for the entire model development lifecycle, including data cleaning, tokenizer training, model pre-training, SFT instruction fine-tuning, and RLHF optimization. The project is designed to be resource-efficient, capable of pre-training on machines with as little as 4GB VRAM and requiring only 512MB VRAM for float16 inference. It also supports downstream task fine-tuning, with an example provided for triplet information extraction. All dataset sources, data cleaning processes, and training procedures are openly shared, making it an excellent resource for researchers and developers working with small-scale Chinese language models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
