Shypd.aiThe largest open index of AI toolsMatX provides high-throughput chips specifically designed for large language models (LLMs), offering superior performance for training, prefill, and decode operations. It delivers high FLOPS/mm² and excellent scale-up/scale-out interconnects for massive AI clusters.
Trending
About
MatX specializes in developing high-throughput chips optimized for the demanding requirements of large language models (LLMs). Their MatX One chip is engineered to provide higher throughput than competing products, while also achieving low latencies crucial for various AI workloads. It excels in FLOPS for training and prefill, and offers exceptional latency, FLOPS, and long-context support for decode and reinforcement learning. Key features include the highest FLOPS/mm², efficient handling of weights in SRAM for low latency, and support for over 2000 output tokens/second for large MoE models. The chips also boast robust scale-up and scale-out interconnects, enabling clusters with hundreds of thousands of chips. MatX targets workloads such as training, RL, inference prefill, and inference decode, supporting both large MoE and dense models without an upper limit on model size.
Capabilities
Pricing & Plans
Likely Not Free
Free
FAQs
Trending
