jiuyuan
/
CPM-9G-8B
5
0
Fork 54
Code Issues Pull Requests Projects Releases Wiki Activity

Update README_LORA.md

This commit is contained in:
p04896573 2024-05-11 17:54:49 +08:00
parent 86d5191e13
commit 832a7841af
1 changed files with 2 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
quick_start_clean/readmes/README_LORA.md
View File

@ -67,12 +67,10 @@ $CMD
``` ```
## 合并模型 ## 合并模型
训练好的lora delta model一般有两种方式
- 在直接含有lora的推理代码进行推理
- 将lora delta model参数和original model merge在一起 作为新的模型，但是模型的参数数量并没有增多 - 将lora delta model参数和original model merge在一起 作为新的模型，但是模型的参数数量并没有增多
```python
python merge_lora_delta.py --base_path cpm9g-8b-sft.pt --delta_path cpm9g-lora.pt --merge_path cpm9g-8b-sft_with_lora.pt python merge_lora_delta.py --base_path cpm9g-8b-sft.pt --delta_path cpm9g-lora.pt --merge_path cpm9g-8b-sft_with_lora.pt
```
# lora 推理 # lora 推理