Commit Graph

1620 Commits

Author SHA1 Message Date
hiyouga 76c61905b2 fix ppo+zero3 #3108 2024-06-06 23:30:07 +08:00
hiyouga 451b6693c0 fix torch gc 2024-06-06 20:30:25 +08:00
hiyouga 149610c636 fix ppo dataset bug #4012 2024-06-06 19:03:20 +08:00
hiyouga fad2591e31 update trainers 2024-06-06 18:45:49 +08:00
hiyouga 67aa78cde0 fix base64 image read #4061 2024-06-06 17:29:19 +08:00
hiyouga 53eb2de75e update readme 2024-06-06 16:59:18 +08:00
hiyouga 87a7822b98 update readme 2024-06-06 16:25:42 +08:00
hiyouga cae4737907 lora modules: all by default 2024-06-06 03:53:28 +08:00
hiyouga c23cc63d3d add codestral 22B 2024-06-06 03:42:50 +08:00
hiyouga 7daf8366db lint 2024-06-06 03:33:44 +08:00
hoshi-hiyouga f2580ad403
Merge pull request #4066 from injet-zhou/main
add throughput entry to training log
2024-06-06 03:32:04 +08:00
hoshi-hiyouga ca459f67eb
Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting
2024-06-06 03:15:44 +08:00
hoshi-hiyouga feaee36c46
Update export.py 2024-06-06 03:14:46 +08:00
hoshi-hiyouga af2c3cbee4
Update model_args.py 2024-06-06 03:14:23 +08:00
hoshi-hiyouga 0e740aa463
Merge pull request #4053 from hzhaoy/feature/add_select_config_file
Support selecting saved configuration files
2024-06-06 03:06:03 +08:00
hiyouga 8fcc79e1e6 add vllm_dtype arg #3387 #3717 2024-06-06 02:53:27 +08:00
hiyouga a12a506c3d support train from scratch #4033 #4075 2024-06-06 02:43:19 +08:00
hiyouga 946f601136 support image input in api #3971 #4061 2024-06-06 02:29:55 +08:00
hiyouga dc4a00dd63 update train hparams 2024-06-06 01:49:20 +08:00
hiyouga 4dc0632145 fix setup 2024-06-06 01:39:02 +08:00
hiyouga d4908d5708 add llamafactory-cli env 2024-06-06 01:28:14 +08:00
hiyouga 67fe822324 fix #4090 2024-06-06 00:50:32 +08:00
MengqingCao 2c03052662 modify export_device option 2024-06-05 09:37:36 +00:00
hiyouga 83a005e3d4 fix #4079 2024-06-05 16:56:54 +08:00
hiyouga eef1e542a9 update readme 2024-06-05 16:32:32 +08:00
hiyouga f48f5e646e support glm-4 2024-06-05 15:16:38 +08:00
MengqingCao 07045c876a add npu for model export 2024-06-05 07:06:40 +00:00
faddddeout b2f0459542 add throughput entry to log 2024-06-04 11:04:29 +00:00
hiyouga 82a565362c update wechat 2024-06-04 15:52:56 +08:00
hzhaoy b27c4cfcb3 add: support selecting saved configuration files and loading training parameters 2024-06-04 10:33:43 +08:00
hiyouga 5a13b3baa6 tiny fix 2024-06-04 00:31:10 +08:00
hiyouga 91611d68c4 fix #3873 2024-06-04 00:21:50 +08:00
hiyouga a18acf2abe fix #3992 2024-06-04 00:17:36 +08:00
hiyouga 2187518762 fix abort in webui DDP mode 2024-06-04 00:10:24 +08:00
hoshi-hiyouga ae18e1e251
Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui
2024-06-04 00:04:07 +08:00
hiyouga 79784ebeb6 fix #4043 2024-06-03 23:30:37 +08:00
hiyouga f9a206509e remove gc warnings in DPO&KTO 2024-06-03 22:53:54 +08:00
hoshi-hiyouga 30a538e2db
Merge pull request #4045 from enji-zhou/feature/add_kto
fix KTO Trainer Sampler
2024-06-03 22:09:25 +08:00
hoshi-hiyouga 24499f40dc
Update trainer.py 2024-06-03 22:08:38 +08:00
enji.zhou 34a2c5087a fix KTO Trainer Sampler 2024-06-03 21:32:38 +08:00
hoshi-hiyouga 0f01500b68
Merge pull request #4006 from Uminosachi/scheduler-kwargs
Set scheduler_specific_kwargs to get_scheduler
2024-06-03 19:27:53 +08:00
hiyouga 88681d3357 update placeholder in issue template 2024-06-03 19:24:10 +08:00
hoshi-hiyouga d359dd2de4
Merge pull request #4011 from statelesshz/issue-template
Update bug-report.yml
2024-06-03 19:20:43 +08:00
hiyouga eed33862bc fix #4005 #4013 2024-06-03 19:12:29 +08:00
hoshi-hiyouga 1539c72b94
Merge pull request #4007 from xu-song/patch-3
Update model_args.py
2024-06-03 18:54:37 +08:00
hiyouga 24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga 876bc92865 bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
2024-06-03 18:29:38 +08:00
hiyouga 49b1e88e3d fix data loader hint 2024-06-03 18:28:27 +08:00
Xu Song dade2f083d
Update model_args.py 2024-05-31 14:35:48 +08:00
statelesshz f78e21f341 Update bug-report.yml 2024-05-31 13:18:18 +08:00