Commit Graph

1219 Commits

Author SHA1 Message Date
hiyouga db7f3b9784 update readme 2024-04-22 17:09:17 +08:00
hiyouga 836ca05586 update readme 2024-04-22 00:51:35 +08:00
hiyouga 34d66a3a85 update readme 2024-04-22 00:42:25 +08:00
hiyouga a1f1fac33b update readme and examples 2024-04-22 00:37:32 +08:00
hiyouga ddbd29d777 remove extras 2024-04-22 00:35:41 +08:00
hiyouga 1197513a16 Update wechat.jpg 2024-04-22 00:22:58 +08:00
hiyouga a83e7587a0 update readme 2024-04-22 00:21:01 +08:00
hiyouga 3e1bf8325c set dev version 2024-04-21 23:14:30 +08:00
hiyouga e0d6b72d56 release v0.6.3 2024-04-21 23:13:23 +08:00
hiyouga 4469a3237d fix #3366 2024-04-21 21:34:25 +08:00
hiyouga fbbe0dba2f fix optimizers 2024-04-21 20:40:54 +08:00
hiyouga a1d31ffc8c fix #3365 2024-04-21 19:20:18 +08:00
hiyouga 5c62881c5a fix bug in galore optimizer 2024-04-21 18:53:22 +08:00
hiyouga f58425ab45 fix mod stuff 2024-04-21 18:11:10 +08:00
hoshi-hiyouga d0273787be
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
2024-04-21 18:05:52 +08:00
hoshi-hiyouga 1fa287fd63 fix #3348 2024-04-20 10:34:09 +08:00
hiyouga 6339edefff add dpo mix dataset 2024-04-20 01:31:38 +08:00
hiyouga ba559a659a fix #3352 2024-04-19 22:40:01 +08:00
hiyouga 14a605a2da fix llama3 template 2024-04-19 15:46:51 +08:00
Marco 4fb7e046b3 fix small typo 2024-04-18 20:33:29 +02:00
Marco 620add7b9f Added Mixture of Depths 2024-04-18 20:31:24 +02:00
hoshi-hiyouga 2aaaede247 support llama3 2024-04-19 01:13:50 +08:00
hiyouga 942362d008 fix #3324 2024-04-18 15:34:45 +08:00
hiyouga 3b43a3b7c5 tiny fix 2024-04-18 00:22:17 +08:00
hiyouga e2f1c6fc6a update readme 2024-04-17 23:40:49 +08:00
hiyouga cab0598fd0 add mixtral 8x22B models 2024-04-17 23:35:59 +08:00
hiyouga 5f86053d75 add CodeQwen models 2024-04-17 23:27:22 +08:00
hiyouga c9a477322d fix #3316 2024-04-17 22:54:34 +08:00
hiyouga 6d641af703 fix #3317 2024-04-17 22:17:19 +08:00
hiyouga e3ca57602c Update wechat.jpg 2024-04-17 21:14:37 +08:00
hiyouga 278c5e10c4 lint 2024-04-16 18:21:09 +08:00
hoshi-hiyouga aa3206ec26
Merge pull request #3291 from codemayq/main
support for previewing custom dataset in directory format
2024-04-16 18:12:09 +08:00
hiyouga c00f0771a5 Update parser.py 2024-04-16 18:09:31 +08:00
hiyouga 5d62a51c12 update readme and gradio version 2024-04-16 18:09:16 +08:00
hiyouga e3d8fc75eb support badam for all stages 2024-04-16 17:44:48 +08:00
hoshi-hiyouga 4d660c5ade
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
2024-04-16 17:32:16 +08:00
hoshi-hiyouga c9828f4c6e
Update utils.py 2024-04-16 17:30:12 +08:00
hoshi-hiyouga 6700a1b9fa
Update trainer.py 2024-04-16 17:29:52 +08:00
hoshi-hiyouga 38a56706e0
Update utils.py 2024-04-16 17:29:30 +08:00
hoshi-hiyouga a950f3b81d
Update patcher.py 2024-04-16 17:29:19 +08:00
hoshi-hiyouga 750cdf2e74
Update adapter.py 2024-04-16 17:28:12 +08:00
hoshi-hiyouga 4660703674
Update parser.py 2024-04-16 17:27:25 +08:00
hoshi-hiyouga 5b59ff4212
Update parser.py 2024-04-16 17:27:02 +08:00
hoshi-hiyouga ec899cccf3
Update finetuning_args.py 2024-04-16 17:26:30 +08:00
hoshi-hiyouga 57dcd91e17
Update sft.sh 2024-04-16 17:25:40 +08:00
hoshi-hiyouga 50ced257e0
Update requirements.txt 2024-04-16 17:10:17 +08:00
hoshi-hiyouga f4b4a26c64
Update setup.py 2024-04-16 17:10:02 +08:00
Jonery 86900210d3 remove badam from core requirements 2024-04-16 12:25:50 +08:00
Jonery 7ecb61822b resolve gradient checkpointing issue. 2024-04-16 12:05:27 +08:00
codingma 62294289dc add check 2024-04-16 10:56:39 +08:00