Commit Graph

21 Commits

Author SHA1 Message Date
efort fec6a8e275 更新 basic_demo/openai_api_server.py 2025-02-10 15:29:49 +08:00
efort 7cf4f4f422 更新 basic_demo/openai_api_server.py 2025-02-10 15:05:51 +08:00
sixsixcoder 9f98825a63 add glm4v openai server 2024-09-06 05:59:41 +00:00
ghohoj f887394c02 fix: fix flow output when having tools 2024-07-22 10:17:09 +08:00
zR 1de40b055f update report 2024-06-20 11:33:05 +08:00
zR b475ebe8ae update finetune demo 2024-06-19 11:22:31 +08:00
zR bab384d193
Merge pull request #155 from qq332982511/add_api_backend
composite demo add openai backend
2024-06-19 01:14:14 +08:00
zR ab011a344e add requirement of finetune 2024-06-19 01:12:20 +08:00
L eb8aeb37c1 修正非流式输出和process_response tools参数的bug 2024-06-18 21:02:29 +08:00
zR ef015f88f9 跟进OpenAI server部分代码解释
with liuzhenghua
2024-06-18 18:13:12 +08:00
zR 5c4bf6201c fix openai stream function 2024-06-15 20:59:23 +08:00
yybear 293ca3b834 composite demo add openai backend 2024-06-12 23:59:22 +08:00
zR a9fe1aba02 add openai demo stream and function call
fix #130 #124
2024-06-09 16:11:20 +08:00
zR 20a9f26ec6 更新部分说明 2024-06-08 13:26:43 +08:00
zR abe93e093d openai demo update
#64 #36
2024-06-07 22:14:00 +08:00
Lian Junhong 0b979f8bdb
Fix openai_api_server request_id issue
add request_id=f"{time.time()}" to Fix API concurrency request issue
2024-06-06 12:37:26 +08:00
zR 1683d673d2 fix #60 and #51 2024-06-06 10:14:15 +08:00
zR 3f26ccc208 fix readme error 2024-06-06 10:00:11 +08:00
xusenlin 11e244c0f2 fix process response function 2024-06-05 16:11:54 +08:00
Lao 205b7db3cc
Update openai_api_server.py
Changed vllm’s gpu memory utilization
2024-06-05 11:48:20 +08:00
duzx16 c0a6d1e0fa init commit 2024-06-05 10:22:16 +08:00