p04798526
/
CPM-9G-8B
forked from jiuyuan/CPM-9G-8B
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

fix: change --language to zh

This commit is contained in:
wql 2024-08-07 14:21:33 +08:00
parent 5de2ff4556
commit a62a188fd5
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
quick_start_clean/data_preprocess.sh
View File

@ -6,4 +6,4 @@ mkdir raw_data_repeat
mv raw_data/alpaca_zh_repeat.jsonl raw_data_repeat/data.jsonl mv raw_data/alpaca_zh_repeat.jsonl raw_data_repeat/data.jsonl
python convert_json2index.py --path raw_data_repeat/data.jsonl --language en --output alpaca_zh_repeat python convert_json2index.py --path raw_data_repeat/data.jsonl --language zh --output alpaca_zh_repeat