jiuyuan
/
CPM-9G-8B
5
0
Fork 57
Code Issues Pull Requests Projects Releases Wiki Activity

Update quick_start.md

This commit is contained in:
p04896573 2024-12-05 10:31:59 +08:00
parent e747382e0d
commit ef028167cd
1 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
quick_start_clean/readmes/quick_start.md
View File

@ -107,9 +107,10 @@ pip install sentencepiece
pip install protobuf==3.20.0 #protobuf版本过高时无法适配tensorboard
pip install tensorboard
pip install tensorboardX
9.安装vllm（模型推理）
```
### 推理环境安装
```
装vllm（模型推理）
我们提供基于CUDA12.2环境下python3.8、python3.10版本的vllm安装包，相关依赖均已封装，可直接安装后执行推理：
[vllm-0.5.0.dev0+cu122-cp38-cp38-linux_x86_64.whl](https://qy-obs-6d58.obs.cn-north-4.myhuaweicloud.com/vllm-0.5.0.dev0%2Bcu122-cp38-cp38-linux_x86_64.whl)
[vllm-0.5.0.dev0+cu122-cp310-cp310-linux_x86_64.whl](https://qy-obs-6d58.obs.cn-north-4.myhuaweicloud.com/vllm-0.5.0.dev0%2Bcu122-cp310-cp310-linux_x86_64.whl)