forked from jiuyuan/CPM-9G-8B
修改一些格式问题
This commit is contained in:
parent
5cf676b5a3
commit
04edd8740d
|
@ -128,7 +128,6 @@ pip install tensorboardX
|
||||||
1. 参考以下脚本,将txt数据处理为jsonl格式:
|
1. 参考以下脚本,将txt数据处理为jsonl格式:
|
||||||
```python
|
```python
|
||||||
# convert_txt2jsonl.py
|
# convert_txt2jsonl.py
|
||||||
|
|
||||||
import json
|
import json
|
||||||
import sys
|
import sys
|
||||||
|
|
||||||
|
|
Loading…
Reference in New Issue