zR
|
d71b8c2284
|
comment with trust_remote_code=True
|
2024-11-01 18:49:55 +08:00 |
sixgod
|
471943bfd7
|
support INT4 inference
|
2024-11-01 10:21:56 +00:00 |
|
sixgod
|
e3e6de52c4
|
transformers4.46 and vllm0.6.3
|
2024-11-01 09:00:39 +00:00 |
|
zR
|
3dec01c6d5
|
dtype use bf16
|
2024-07-02 01:00:12 +08:00 |
|
zR
|
e5b5630498
|
fix #232
|
2024-06-24 23:45:04 +08:00 |
|
zR
|
a9fe1aba02
|
add openai demo stream and function call
fix #130 #124
|
2024-06-09 16:11:20 +08:00 |
|
zR
|
7fcaeba6cc
|
finetune and vision demo update
|
2024-06-07 16:53:56 +08:00 |
|
zR
|
29480b7394
|
add vision demo
|
2024-06-05 13:21:23 +08:00 |