Shypd.aiThe largest open index of AI toolsIntel Neural Compressor is an open-source Python library that provides state-of-the-art model compression techniques, including low-bit quantization and sparsity. It optimizes deep learning models across PyTorch, TensorFlow, and JAX for various Intel hardware.
Trending
About
Intel Neural Compressor is an open-source Python library developed by Intel, offering advanced model compression techniques for deep learning frameworks like PyTorch, TensorFlow, and JAX. It supports a wide range of low-bit quantization methods, including INT8, FP8, MXFP8, INT4, MXFP4, and NVFP4, as well as sparsity. The library is designed to optimize the performance of Large Language Models (LLMs) and Vision-Language Models (VLMs) on Intel hardware such as Xeon Scalable Processors, Core Ultra Processors, and Gaudi AI Accelerators, with limited support for AMD and ARM CPUs, and NVIDIA GPUs. Key features include Static Quantization, Dynamic Quantization, SmoothQuant, Weight-Only Quantization, and Quantization-Aware Training, making it a comprehensive solution for deploying efficient AI models.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
