Commit Graph

1797 Commits

Author SHA1 Message Date
MengqingCao 07045c876a add npu for model export 2024-06-05 07:06:40 +00:00
faddddeout b2f0459542 add throughput entry to log 2024-06-04 11:04:29 +00:00
hiyouga 82a565362c update wechat 2024-06-04 15:52:56 +08:00
hzhaoy b27c4cfcb3 add: support selecting saved configuration files and loading training parameters 2024-06-04 10:33:43 +08:00
hiyouga 5a13b3baa6 tiny fix 2024-06-04 00:31:10 +08:00
hiyouga 91611d68c4 fix #3873 2024-06-04 00:21:50 +08:00
hiyouga a18acf2abe fix #3992 2024-06-04 00:17:36 +08:00
hiyouga 2187518762 fix abort in webui DDP mode 2024-06-04 00:10:24 +08:00
hoshi-hiyouga ae18e1e251
Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui
2024-06-04 00:04:07 +08:00
hiyouga 79784ebeb6 fix #4043 2024-06-03 23:30:37 +08:00
hiyouga f9a206509e remove gc warnings in DPO&KTO 2024-06-03 22:53:54 +08:00
hoshi-hiyouga 30a538e2db
Merge pull request #4045 from enji-zhou/feature/add_kto
fix KTO Trainer Sampler
2024-06-03 22:09:25 +08:00
hoshi-hiyouga 24499f40dc
Update trainer.py 2024-06-03 22:08:38 +08:00
enji.zhou 34a2c5087a fix KTO Trainer Sampler 2024-06-03 21:32:38 +08:00
hoshi-hiyouga 0f01500b68
Merge pull request #4006 from Uminosachi/scheduler-kwargs
Set scheduler_specific_kwargs to get_scheduler
2024-06-03 19:27:53 +08:00
hiyouga 88681d3357 update placeholder in issue template 2024-06-03 19:24:10 +08:00
hoshi-hiyouga d359dd2de4
Merge pull request #4011 from statelesshz/issue-template
Update bug-report.yml
2024-06-03 19:20:43 +08:00
hiyouga eed33862bc fix #4005 #4013 2024-06-03 19:12:29 +08:00
hoshi-hiyouga 1539c72b94
Merge pull request #4007 from xu-song/patch-3
Update model_args.py
2024-06-03 18:54:37 +08:00
hiyouga 24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga 876bc92865 bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
2024-06-03 18:29:38 +08:00
hiyouga 49b1e88e3d fix data loader hint 2024-06-03 18:28:27 +08:00
ylfeng b47e317447 remove empty line 2024-05-31 21:43:08 +08:00
ylfeng 84aee57901 fix eos 2024-05-31 21:40:41 +08:00
ylfeng f9db439cb7 supervised packing with greedy knapsack algorithm 2024-05-31 15:33:54 +08:00
Xu Song dade2f083d
Update model_args.py 2024-05-31 14:35:48 +08:00
statelesshz f78e21f341 Update bug-report.yml 2024-05-31 13:18:18 +08:00
Uminosachi 14e97dc119 Set scheduler_specific_kwargs to get_scheduler 2024-05-31 13:45:39 +09:00
hiyouga c4f50865ad update readme 2024-05-30 16:40:17 +08:00
faddddeout b13d03946e fix cann't interrupt training when using multi GPUs in webui 2024-05-30 08:39:21 +00:00
hoshi-hiyouga 2f38c1f5fd Update wechat.jpg 2024-05-30 12:48:47 +08:00
hiyouga 3404e8f302 fix #3837 2024-05-30 00:52:26 +08:00
hoshi-hiyouga 483eb47e5d
Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num
Add dataset sample num
2024-05-30 00:25:45 +08:00
hoshi-hiyouga ca5dd7c6c1
Update loader.py 2024-05-30 00:20:20 +08:00
hoshi-hiyouga f9a88b89ca
Update loader.py 2024-05-30 00:17:21 +08:00
hoshi-hiyouga b55fb611c5
Update loader.py 2024-05-30 00:12:12 +08:00
hoshi-hiyouga 51dd454337
Update parser.py 2024-05-30 00:05:20 +08:00
hoshi-hiyouga c8ae7e0e65
Update README_zh.md 2024-05-30 00:04:47 +08:00
hoshi-hiyouga 3761d7d5dd
Update README.md 2024-05-30 00:04:26 +08:00
hiyouga 8070871732 better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
2024-05-29 23:55:38 +08:00
hiyouga d0aa36b8ad fix cohere system 2024-05-29 20:58:23 +08:00
hiyouga 0930f58699 fix #3965 2024-05-29 20:55:51 +08:00
hiyouga 89ca832740 update readme 2024-05-29 18:39:11 +08:00
hoshi-hiyouga 880b4a9acf
Merge pull request #3930 from MengqingCao/npu
Add Ascend npu doc and dependency
2024-05-29 18:33:38 +08:00
MengqingCao b19d33b9d2 update torch-npu version 2024-05-29 10:05:11 +00:00
MengqingCao e14f5b37e4 update cann kernels url 2024-05-29 09:53:31 +00:00
hoshi-hiyouga bcddd5b066
Merge pull request #3958 from hzhaoy/add_telechat_12b_support
add TeleChat-12B/TeleChat-12B-v2 models
2024-05-29 17:20:53 +08:00
hzhaoy 0dd632fe9e add TeleChat-12B/TeleChat-12B-v2 models 2024-05-29 15:00:37 +08:00
codemayq 4728fe62d1 update wechat_npu 2024-05-29 11:13:59 +08:00
hiyouga 97346c1d3d fix hf chat engine 2024-05-29 01:20:07 +08:00