Commit Graph

8 Commits

Author SHA1 Message Date
liuzhenghua-jk 8dd5ad6fa1 fix: extra newline token in stream mode 2024-06-06 12:07:26 +08:00
liuzhenghua-jk 61aff1fd8e fix: extra newline token in stream mode 2024-06-06 11:58:29 +08:00
liuzhenghua-jk 20ef30a46b fix: #issue65 2024-06-06 11:37:28 +08:00
zR 1683d673d2 fix #60 and #51 2024-06-06 10:14:15 +08:00
zR 3f26ccc208 fix readme error 2024-06-06 10:00:11 +08:00
xusenlin 11e244c0f2 fix process response function 2024-06-05 16:11:54 +08:00
Lao 205b7db3cc
Update openai_api_server.py
Changed vllm’s gpu memory utilization
2024-06-05 11:48:20 +08:00
duzx16 c0a6d1e0fa init commit 2024-06-05 10:22:16 +08:00