Commit Graph

13 Commits

Author SHA1 Message Date
hiyouga 7159bc54ed add datasets 2023-07-19 20:59:15 +08:00
hiyouga 08439d29b2 fix Baichuan-13B 2023-07-13 23:08:45 +08:00
zxbsmk 4955dc9eed Support for WebNovel dataset 2023-07-12 17:29:47 +08:00
hiyouga 3154fec979 add open assistant dataset 2023-06-28 23:09:33 +08:00
hiyouga 334d1a6d26 add belle multiturn dataset 2023-06-16 20:01:16 +08:00
hiyouga cec6524d6b support RM metrics, add generating Args 2023-06-12 15:48:48 +08:00
BUAADreamer e3b53a67c7 update json line file to .jsonl 2023-06-11 18:59:19 +08:00
BUAADreamer 676d910260 add some 2023-06-11 18:55:53 +08:00
BUAADreamer a2af9df5a9 add code for reading from multi files in one directory 2023-06-10 16:27:30 +08:00
BUAADreamer 3dd5f9a874 add code for reading from multi files in one directory 2023-06-10 15:53:47 +08:00
hiyouga a72492e649 remove dummy code 2023-05-30 16:28:00 +08:00
hiyouga 8ff96509fa add pre-training script 2023-05-29 21:37:22 +08:00
hiyouga 769c6ab56b Initial commit 2023-05-28 18:09:04 +08:00