Chatglm-Openai-Api

Visit Tool

chatglm-openai-api provides an OpenAI-style API for ChatGLM-6B/ChatGLM2-6B and Chinese Embeddings Models. It allows developers to integrate these models into their applications using a familiar API interface.

Claim this tool

No Views Yet

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is chatglm-openai-api?

chatglm-openai-api is an open-source project that offers an OpenAI-compatible API for various large language models, specifically ChatGLM-6B, ChatGLM2-6B, and Chinese Embeddings Models. This tool simplifies the integration of these powerful models into existing applications by providing a standardized API interface, similar to what developers are accustomed to with OpenAI. It supports loading models from Hugging Face and running inference on GPUs, with options for local loading and multi-GPU inference. The project also includes advanced features like ngrok and Cloudflare tunnel integration for exposing the API, making it accessible for development and deployment. It's designed for developers looking to leverage these specific models with ease.

Best used for

Ideal for developers who need to integrate ChatGLM-6B/2-6B and Chinese Embeddings Models into their applications, deploy custom AI services, and leverage a familiar OpenAI-style API. Especially valuable for those working with Chinese language processing and requiring flexible deployment options like local loading or tunnel integration.

Common actions

integrate AI models

deploy language models

access ChatGLM API

use Chinese embeddings

collaborationopen-sourceworkflowslow-code/no-code"AI Agents"face swappinggithub copilotdeepfakeautomated workflow

Capabilities

Key features

OpenAI-style API
ChatGLM-6B/2-6B support
Chinese Embeddings Model
Local model loading
Multi-GPU inference
ngrok tunnel integration
Cloudflare tunnel integration

Target Audience

developerdata scientist

Integrations

ngrokcloudflare

Pricing & Plans

Open Source

Free

FAQs

What models does chatglm-openai-api support?

chatglm-openai-api primarily supports ChatGLM-6B, ChatGLM2-6B, and Chinese Embeddings Models. It also has experimental support for FreedomIntelligence/phoenix-inst-chat-7b, allowing developers to integrate these specific language models into their projects via an OpenAI-compatible API.

Can I run chatglm-openai-api on my local machine?

Yes, you can run chatglm-openai-api locally. It supports loading models from local directories and can be configured to run on specific GPUs using CUDA_VISIBLE_DEVICES. This provides flexibility for developers to host and manage the API environment themselves.

How can I expose the API to the internet?

The tool offers integration with ngrok and Cloudflare tunnels to expose the API to the internet. This allows developers to access their deployed ChatGLM API from anywhere, facilitating testing and integration with other online services or client applications.

Trending

Subcategories trending in Coding & Development

Open Source & Models Code Assistants DevOps & Infrastructure No-Code / Low-Code Testing & QA Prompt Engineering

Trending

Also listed in

This tool also appears in

AI Agents & Automation › AI Frameworks & Infra

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce