Shypd.aiThe largest open index of AI toolsTinyLLaVA_Factory is an open-source framework for creating small-scale large multimodal models (LMMs). It offers a modular codebase for customizing LMMs with less coding effort and supports various LLMs, vision towers, and training recipes.
Trending
Also listed in
About
TinyLLaVA_Factory is an open-source modular codebase designed for building small-scale large multimodal models (LMMs). Implemented in PyTorch and HuggingFace, it emphasizes simplicity, extensibility, and reproducibility. The framework allows users to customize their own LMMs with reduced coding effort and fewer mistakes. It integrates a suite of cutting-edge models and methods, supporting LLMs like OpenELM, TinyLlama, StableLM, Qwen, Gemma, and Phi. For vision towers, it includes CLIP, SigLIP, Dino, and combinations thereof. Connectors such as MLP, Qformer, and Resampler are also supported, alongside various training recipes including Frozen/Fully/Partially tuning and LoRA/QLoRA tuning. The project provides trained models, performance benchmarks, and local demo options for Gradio web and CLI inference.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
