p36701958
/
CPM-9G-8B
forked from jiuyuan/CPM-9G-8B
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

upload the model

This commit is contained in:
shuo-git 2024-02-08 16:31:33 +08:00
parent aef17da2c7
commit 7edb356dab
3 changed files with 119710 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
model/config.json Normal file
View File

@ -0,0 +1,14 @@
{
"vocab_size": 119696,
"dropout_p": 0.0,
"eps": 1e-05,
"half": true,
"dim_model": 4096,
"dim_ff": 14336,
"num_layers": 32,
"num_heads": 32,
"num_kv_heads": 32,
"dim_head": 128,
"activate_fn": "silu",
"scale": false
}

BIN
model/cpm9g-8b-sft-epoch-8.pt Normal file
View File

Binary file not shown.

119696
model/vocab.txt Normal file
View File

File diff suppressed because it is too large Load Diff