Commit Graph

11 Commits

Author SHA1 Message Date
zR 8102212b9f fix with vllm requirements.txt 2024-06-06 13:57:22 +08:00
zR 1683d673d2 fix #60 and #51 2024-06-06 10:14:15 +08:00
zR 3f26ccc208 fix readme error 2024-06-06 10:00:11 +08:00
zR a263b69376
Merge pull request #28 from xusenlinzy/main
fix process response function
2024-06-05 18:07:07 +08:00
zR 0423d7ca6d update link 2024-06-05 16:24:36 +08:00
xusenlin 11e244c0f2 fix process response function 2024-06-05 16:11:54 +08:00
zR 29480b7394 add vision demo 2024-06-05 13:21:23 +08:00
zR 12dd318013 add glm-4v-9b stress test 2024-06-05 12:55:41 +08:00
Lao 205b7db3cc
Update openai_api_server.py
Changed vllm’s gpu memory utilization
2024-06-05 11:48:20 +08:00
zR d95f131b03 更新VLLM demo的参数 2024-06-05 11:43:08 +08:00
duzx16 c0a6d1e0fa init commit 2024-06-05 10:22:16 +08:00