Shypd.aiThe largest open index of AI toolsllm-foundry is an Open Source & Models tool that provides code for training, finetuning, evaluating, and deploying LLMs. It is designed for use with Composer and the MosaicML platform, enabling rapid experimentation with the latest techniques.
Trending
About
llm-foundry is a comprehensive open-source repository offering code for the entire lifecycle of Large Language Models (LLMs), from training and finetuning to evaluation and deployment. It is specifically designed to integrate with Composer and the MosaicML platform, providing an efficient and flexible environment for rapid experimentation. The codebase supports various LLM workloads, including data preparation, training HuggingFace and MPT models from 125M to 70B parameters, and benchmarking training throughput and MFU. It also facilitates inference by converting models to HuggingFace or ONNX formats, generating responses, and evaluating LLMs on academic or custom in-context-learning tasks. The repository includes support for DBRX and MPT models, with detailed instructions for local use and community contributions.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
