Shypd.aiThe largest open index of AI toolsFlagGems is an open-source operator library for large language models implemented in the Triton Language. It provides high-performance, backend-neutral kernels to accelerate LLM training and inference across diverse hardware platforms.
Trending
About
FlagGems is a high-performance, generic operator library implemented in the Triton language, designed to accelerate Large Language Model (LLM) training and inference. As part of FlagOS, it aims to unify model-system-chip layers, enabling a "develop once, run anywhere" workflow across various AI accelerators. This approach unlocks hardware performance, eliminates fragmentation among AI chipset-specific software stacks, and significantly lowers the cost of porting and maintaining AI workloads. FlagGems offers a large collection of PyTorch compatible operators, hand-optimized performance for selective operators, and eager-mode readiness. It supports automatic pointwise operator codegen, fast per-function runtime kernel dispatching, and a multi-backend interface for diverse hardware platforms, including over 10 supported backends.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
