Api For Open Llm Versions Save

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

api-for-open-llm-v1.0.4

3 months ago

some fix

api-for-open-llm-v1.0.3

4 months ago

api-for-open-llm-v1.0.2

5 months ago

  • Add support for llama-cpp-python

  • Add DeepSeek, Yi template

  • Refactor project

api-for-open-llm-v1.0.0

5 months ago

fix bug

dev

6 months ago

openai>=1.2.0

v0.0.5

6 months ago

master分支

openai<=0.28.0

api-for-open-llm-v0.0.4

8 months ago

  • Update streamlit demo

  • Add support for repetition penalty

  • Add support for baichuan2 models

api-for-open-llm-v0.0.3

8 months ago

api-for-open-llm-v0.0.2

9 months ago

  • 启动方式参数改为设置环境变量

  • 修改 api 代码结构

api-for-open-llm-v0.0.1

9 months ago