Shypd.aiThe largest open index of AI toolsmistral-inference is an open-source inference library for Mistral models that provides minimal code to run various Mistral models. It supports models like 7B, 8x7B, 8x22B, Codestral, and Mathstral, enabling local deployment and interactive chat.
Trending
About
mistral-inference is an official open-source inference library developed by Mistral AI, designed to provide minimal code for running their large language models. This library supports a wide range of Mistral models, including Mistral 7B, Mixtral 8x7B, Mixtral 8x22B, Codestral 22B, Codestral Mamba 7B, and Mathstral 7B, as well as newer models like Mistral Large 2 and Mistral Small 3.1. It facilitates local installation via PyPI or direct cloning from GitHub, with model weights available for direct download or from the Hugging Face Hub. Users can interact with these models through a command-line interface for demos and interactive chat, supporting both single and multi-GPU setups. The library also provides Python APIs for instruction following, multimodal instruction following, and function calling, making it a versatile tool for developers working with Mistral's AI models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
