Shypd.aiThe largest open index of AI toolsapi-for-open-llm provides an OpenAI-style API for various open large language models, allowing developers to integrate LLMs like LLaMA, BLOOM, and ChatGLM into their applications. It supports streaming responses and text embedding models.
Trending
Also listed in
About
api-for-open-llm is an open-source project that offers a unified backend interface for a wide range of open large language models, designed to mimic the OpenAI ChatGPT API. This allows developers to seamlessly integrate and utilize models such as LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, and ChatGLM into their applications. Key features include support for streaming responses, enabling printer-like effects, and the implementation of text embedding models crucial for document knowledge Q&A. It also integrates with LangChain for advanced LLM development and supports loading fine-tuned LoRA models. The project simplifies the process of using open models as ChatGPT alternatives by requiring only simple environment variable modifications, and it offers vLLM for inference acceleration and concurrent request handling.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
