update readme

This commit is contained in:
zhipuch 2024-09-24 11:15:20 +00:00
parent 81af3cfc5a
commit 0ef093c1a2
2 changed files with 22 additions and 0 deletions

View File

@ -142,5 +142,15 @@ python openai_api_request.py
python trans_stress_test.py
```
##使用昇腾卡运行代码
用户可以在昇腾硬件环境下运行以上代码只需将transformers修改为openmind将device中的cuda设备修改为npu
```shell
#from transformers import AutoModelForCausalLM, AutoTokenizer
from openmind import AutoModelForCausalLM, AutoTokenizer
#device = 'cuda'
device = 'npu'
```

View File

@ -147,3 +147,15 @@ Users can use this code to test the generation speed of the model on the transfo
```shell
python trans_stress_test.py
```
##Use Ascend card to run code
Users can run the above code in the Ascend hardware environment. They only need to change the transformers to openmind and the cuda device in device to npu.
```shell
#from transformers import AutoModelForCausalLM, AutoTokenizer
from openmind import AutoModelForCausalLM, AutoTokenizer
#device = 'cuda'
device = 'npu'
```