Shypd.aiThe largest open index of AI toolsLit-LLaMA is a Coding & Development tool that provides an independent implementation of the LLaMA language model. It supports flash attention, Int8 and GPTQ 4bit quantization, and LoRA and LLaMA-Adapter fine-tuning.
Trending
About
Lit-LLaMA offers an independent and open-source implementation of the LLaMA language model, building upon nanoGPT. It is designed to be simple, numerically correct, optimized for various hardware, and fully open-source under the Apache 2.0 license. The tool supports advanced features like flash attention, Int8 and GPTQ 4bit quantization for efficient memory usage, and LoRA and LLaMA-Adapter fine-tuning for adapting models to specific datasets. While this repository is no longer actively maintained, it serves as a foundational project, with its successor being the Lit-GPT project. It enables users to generate text, finetune models on custom data, and even venture into pre-training on large datasets like RedPajama.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
