Shypd.aiThe largest open index of AI toolsTarsier is a Research & Education tool that provides large-scale video-language models for generating high-quality video descriptions and comprehensive video understanding. It offers state-of-the-art results across various video benchmarks.
Trending
Also listed in
About
Tarsier is a family of large-scale video-language models developed by ByteDance Research, designed to generate high-quality video descriptions and provide comprehensive video understanding. It utilizes a simple model structure combining CLIP-ViT for frame encoding and an LLM for temporal relationships, along with a meticulously designed two-stage training procedure. Tarsier models have demonstrated superior video description capabilities compared to existing open-source models and are comparable to state-of-the-art proprietary models like GPT-4o and Gemini 1.5 Pro. Beyond description, Tarsier is a versatile generalist model achieving new state-of-the-art results across numerous public benchmarks, including multi-choice VQA, open-ended VQA, and zero-shot video captioning. The project also introduces DREAM-1K, a new challenging benchmark for evaluating video description models, and AutoDQ for interpretable automatic evaluation.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
