Shypd.aiThe largest open index of AI toolsT-MAC is an AI Frameworks & Infra tool that enables low-bit LLM inference on CPU/NPU using a lookup table approach. It supports efficient execution of large language models on resource-constrained devices, offering faster inference than dequantization methods.
Trending
Also listed in
About
T-MAC is an open-source AI Frameworks & Infra tool specifically designed for efficient low-bit Large Language Model (LLM) inference on CPU/NPU architectures. It utilizes a lookup table approach to accelerate the execution of LLMs, making it suitable for deployment on resource-constrained devices. The tool supports models like BitNet and offers a significant advantage over traditional dequantization-based methods by providing faster inference speeds. T-MAC aims to optimize the performance of AI models in environments where computational resources are limited, making advanced AI capabilities more accessible and practical for a wider range of applications.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
