Shypd.aiThe largest open index of AI toolsPhi2-mini-Chinese is an open-source AI tool for training small Chinese language models based on the Phi2 architecture. It supports integration with Langchain for retrieval-augmented generation (RAG) using local knowledge bases.
Trending
Also listed in
About
Phi2-mini-Chinese is an experimental open-source project designed for training small Chinese language models from scratch, leveraging the Phi2 architecture. It provides the necessary code and model weights, allowing developers to build their own Phi2-based Chinese chat models. A key feature is its support for integration with Langchain, enabling retrieval-augmented generation (RAG) by loading local knowledge bases. The project details various stages of model development, including data cleaning, tokenizer training (both byte-level and char-level BPE), causal language model (CLM) pre-training, supervised fine-tuning (SFT), and DPO preference optimization. It also includes practical examples for implementing general conversational capabilities and RAG, making it a valuable resource for those looking to customize and deploy Chinese language models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
