Shypd.aiThe largest open index of AI toolsxllm is a high-performance inference engine for large language models, optimized for diverse AI accelerators. It supports efficient deployment of mainstream LLMs on Chinese AI accelerators, enabling high-performance, low-cost AI applications.
Trending
About
xllm is an efficient LLM inference framework specifically optimized for Chinese AI accelerators, designed for enterprise-grade deployment with enhanced efficiency and reduced cost. It adopts a service-engine decoupled inference architecture, achieving breakthrough efficiency through technologies like elastic scheduling, dynamic PD disaggregation, and a hybrid EPD mechanism at the service layer. At the engine layer, it combines multi-stream parallel computing, graph fusion optimization, speculative inference, dynamic load balancing, and global KV cache management. xllm supports efficient deployment of mainstream large models like DeepSeek-V3.1 and Qwen2/3, and is fully deployed in JD.com’s core retail businesses for intelligent customer service, risk control, supply chain optimization, and ad recommendation.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
