Shypd.aiThe largest open index of AI toolsprismatic-vlms is an Open Source & Models tool that provides a flexible and efficient codebase for training visually-conditioned language models (VLMs). It supports various visual representations and language models, enabling easy scaling for large models.
Trending
Also listed in
About
prismatic-vlms offers a flexible and efficient codebase for training visually-conditioned language models (VLMs). It natively supports diverse visual backbones like CLIP, SigLIP, and DINOv2, with an easy mechanism for adding new ones via TIMM. The tool also integrates with arbitrary instances of AutoModelForCausalLM from Transformers, including both base and instruct-tuned language models. Designed for easy scaling, prismatic-vlms leverages PyTorch FSDP and Flash-Attention to efficiently train models ranging from 1B to 34B parameters on configurable dataset mixtures. It also includes an evaluation codebase for rigorously testing VLMs across 12 vision-and-language benchmarks and provides full instructions and configurations for reproducing results.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
