efort
/
glm4
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

issue about wsl and ray 

reminder
This commit is contained in:
Lian Junhong 2024-06-07 15:21:47 +08:00 committed by GitHub
parent b562723d59
commit 97458a4717
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
basic_demo/openai_api_server.py
View File

@ -540,7 +540,7 @@ if __name__ == "__main__":
trust_remote_code=True, trust_remote_code=True,
gpu_memory_utilization=0.9, gpu_memory_utilization=0.9,
enforce_eager=True, enforce_eager=True,
worker_use_ray=True, worker_use_ray=True, # Set to False if you use wsl2 and encounter UnicodeDecodeError. Until https://github.com/ray-project/ray/issues/45492 is fixed.
engine_use_ray=False, engine_use_ray=False,
disable_log_requests=True, disable_log_requests=True,
max_model_len=MAX_MODEL_LENGTH, max_model_len=MAX_MODEL_LENGTH,