jiuyuan
/
CPM-9G-8B
5
0
Fork 54
Code Issues Pull Requests Projects Releases Wiki Activity

1119

This commit is contained in:
carboncoo 2024-11-19 11:01:06 +08:00
parent 8e693d5876
commit c89395164e
1 changed files with 13 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
quick_start_clean/readmes/quick_start.md
View File

@ -454,8 +454,20 @@ python convert_hf_fm9g.py \
## 模型推理
模型推理列举了两种推理方法：离线批量推理和部署OpenAI API服务推理
<!-- 模型推理列举了两种推理方法：离线批量推理和部署OpenAI API服务推理 -->
模型推理目前仅更新了demo脚本
### demo脚本运行
下载开源模型后，在FM_9G/chat_model.py中更改路径：
``` python
root = "checkpoint/"
...
# 输入图像文件路径和文本
url = 'test.jpg'
prompt = '这幅图描述了什么？'
```
运行chat_model.py脚本
<!-- ### 离线批量推理：
离线批量推理可参考以下脚本：
``` python