Shypd.aiThe largest open index of AI toolsmlx-lm is an AI Frameworks & Infra tool that enables running and fine-tuning large language models on Apple silicon. It integrates with Hugging Face Hub for easy access to thousands of LLMs and supports quantization.
Trending
About
mlx-lm is a Python package designed for generating text and fine-tuning large language models (LLMs) specifically on Apple silicon using the MLX framework. It offers seamless integration with the Hugging Face Hub, allowing users to easily access and utilize a vast array of LLMs with simple commands. Key features include support for quantizing models, uploading them to the Hugging Face Hub, and performing both low-rank and full model fine-tuning, even with quantized models. The package also provides distributed inference and fine-tuning capabilities with `mx.distributed`, and tools for efficient handling of long prompts and generations through a rotating fixed-size key-value cache and prompt caching.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
