Commit Graph

387 Commits

Author SHA1 Message Date
hiyouga 2340b0d7df fix MMLU 2023-09-23 00:42:23 +08:00
hiyouga 465ee8119a add MMLU and C-Eval script 2023-09-23 00:34:17 +08:00
hiyouga 5cc7a44784 fix #1000 2023-09-22 15:00:48 +08:00
hiyouga 044d4425b4 update readme 2023-09-22 14:34:13 +08:00
hiyouga 5f3ab3ddde fix webui 2023-09-21 19:55:38 +08:00
hiyouga dbaef776a1 tiny fix 2023-09-21 19:52:06 +08:00
hiyouga 338b8664ed fix #944 2023-09-21 19:51:02 +08:00
hiyouga ace3f85a72 tiny fix 2023-09-21 15:25:29 +08:00
hiyouga e510006ed6 Merge branch 'main' of https://github.com/hiyouga/LLaMA-Efficient-Tuning 2023-09-21 13:52:19 +08:00
hiyouga 837b487d8a Update wechat.jpg 2023-09-21 13:52:02 +08:00
hoshi-hiyouga ac8648b431
Merge pull request #975 from statelesshz/npu-support
Add Ascend NPU support
2023-09-20 14:56:50 +08:00
statelesshz b3e41c6d49 support export model on Ascend NPU 2023-09-20 10:26:02 +08:00
hiyouga 10ab2f8b90 fix webui 2023-09-19 18:35:21 +08:00
hiyouga 7e8655c8b5 fix error info 2023-09-19 18:30:23 +08:00
hiyouga 469f859161 add tests.cal_flops.py 2023-09-16 23:40:41 +08:00
hiyouga acda45e463 update readme 2023-09-16 17:33:01 +08:00
hiyouga 0b5f970c05 fix #913 2023-09-15 20:58:28 +08:00
hiyouga 8632bff811 fix #896 2023-09-14 18:37:34 +08:00
hiyouga 8857e45602 fix #887 2023-09-14 17:56:58 +08:00
hoshi-hiyouga 3202985087
Merge pull request #900 from mmbwf/main
Fix PPO replace_model loading wrong default parameters.
2023-09-14 17:34:22 +08:00
hiyouga bd4e24bfee Update wechat.jpg 2023-09-14 16:31:11 +08:00
mmbwf 30fb721f12
Update utils.py
Fix parameters load error.
2023-09-14 15:38:04 +08:00
hiyouga 026af87e7f add MathInstruct dataset 2023-09-13 22:30:14 +08:00
hiyouga 7ba57d5b14 fix ppo save model 2023-09-12 16:25:29 +08:00
hiyouga d4be857e23 fix #762 #814 2023-09-12 16:10:10 +08:00
hiyouga 3b306478d4 tiny fix 2023-09-11 18:27:08 +08:00
hiyouga ccb3553576 Release v0.1.8 2023-09-11 17:31:34 +08:00
hiyouga 0fbece85a7 update flashattn, fix ppo save model 2023-09-11 17:25:36 +08:00
hiyouga b218c271ed remove PeftTrainer 2023-09-10 22:23:23 +08:00
hiyouga baac22f4f4 truncate readme 2023-09-10 21:04:20 +08:00
hiyouga 63611de7ae update readme 2023-09-10 21:01:20 +08:00
hiyouga 34005252df update readme 2023-09-10 20:52:21 +08:00
hiyouga d8aa1404be support FlashAttention2 2023-09-10 20:43:56 +08:00
hiyouga 815b92e698 fix #850 2023-09-10 14:22:03 +08:00
hiyouga a51b7c98ac fix lora target 2023-09-09 17:04:45 +08:00
hiyouga bca1a247bc support lora target auto find 2023-09-09 15:38:37 +08:00
hiyouga d8d82ca281 fix chatglm2 tokenizer 2023-09-09 13:50:29 +08:00
hiyouga d2015c8e12 add baichuan2 convert script 2023-09-08 22:59:41 +08:00
hiyouga 90bd085ae4 fix bug in DPO data collator 2023-09-08 20:45:07 +08:00
hiyouga b34797a845 fix #761 2023-09-08 20:22:18 +08:00
hiyouga 8ea32e4046 change to right-padding, update reward score #803 2023-09-08 20:04:31 +08:00
hiyouga 8aaaa132d4 fix chatglm template 2023-09-08 14:45:58 +08:00
hiyouga 8b66247d2f Update wechat.jpg 2023-09-07 20:56:07 +08:00
hiyouga f5351c18e1 update requirements 2023-09-07 19:26:25 +08:00
hiyouga 5a9970dbef fix #818 2023-09-07 19:19:53 +08:00
hiyouga ed1c2c5557 add deepspeed check in PPO training 2023-09-07 19:12:40 +08:00
hiyouga e2bf7c3bad fix #809 2023-09-07 19:04:32 +08:00
hiyouga 85b1f6632a fix baichuan templates 2023-09-07 18:54:14 +08:00
hiyouga 0531886e1f update baichuan2 template 2023-09-06 21:43:06 +08:00
hiyouga 60603a94c6 add Baichuan2 models 2023-09-06 18:40:11 +08:00