Shypd.aiThe largest open index of AI toolsPerception Models is an Open Source & Models tool that provides state-of-the-art models for image, video, and audio perception. It includes Perception Encoder (PE) for encoding and Perception Language Model (PLM) for decoding, offering powerful capabilities for AI research.
Trending
About
Perception Models is a comprehensive repository offering state-of-the-art AI models for image, video, and audio perception. It features the Perception Encoder (PE) for robust encoding across various modalities, including core vision-language tasks, LLM-aligned vision-language modeling, and spatially-tuned dense prediction. Additionally, it provides the Perception Language Model (PLM) for decoding, facilitating research in vision-language modeling with open and reproducible models. The repository also includes PE Audio-Visual and PE Audio-Frame models, expanding its capabilities to joint audio-visual embedding and audio event localization. With extensive benchmarks and clear getting started guides, Perception Models is an invaluable resource for developers and researchers working on advanced multimodal AI applications.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
