Commit Graph

1305 Commits

Author SHA1 Message Date
hoshi-hiyouga d0273787be
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
2024-04-21 18:05:52 +08:00
hoshi-hiyouga 1fa287fd63 fix #3348 2024-04-20 10:34:09 +08:00
hiyouga 6339edefff add dpo mix dataset 2024-04-20 01:31:38 +08:00
hiyouga ba559a659a fix #3352 2024-04-19 22:40:01 +08:00
hiyouga 14a605a2da fix llama3 template 2024-04-19 15:46:51 +08:00
Marco 4fb7e046b3 fix small typo 2024-04-18 20:33:29 +02:00
Marco 620add7b9f Added Mixture of Depths 2024-04-18 20:31:24 +02:00
hoshi-hiyouga 2aaaede247 support llama3 2024-04-19 01:13:50 +08:00
hiyouga 942362d008 fix #3324 2024-04-18 15:34:45 +08:00
hiyouga 3b43a3b7c5 tiny fix 2024-04-18 00:22:17 +08:00
hiyouga e2f1c6fc6a update readme 2024-04-17 23:40:49 +08:00
hiyouga cab0598fd0 add mixtral 8x22B models 2024-04-17 23:35:59 +08:00
hiyouga 5f86053d75 add CodeQwen models 2024-04-17 23:27:22 +08:00
hiyouga c9a477322d fix #3316 2024-04-17 22:54:34 +08:00
hiyouga 6d641af703 fix #3317 2024-04-17 22:17:19 +08:00
hiyouga e3ca57602c Update wechat.jpg 2024-04-17 21:14:37 +08:00
hiyouga 278c5e10c4 lint 2024-04-16 18:21:09 +08:00
hoshi-hiyouga aa3206ec26
Merge pull request #3291 from codemayq/main
support for previewing custom dataset in directory format
2024-04-16 18:12:09 +08:00
hiyouga c00f0771a5 Update parser.py 2024-04-16 18:09:31 +08:00
hiyouga 5d62a51c12 update readme and gradio version 2024-04-16 18:09:16 +08:00
hiyouga e3d8fc75eb support badam for all stages 2024-04-16 17:44:48 +08:00
hoshi-hiyouga 4d660c5ade
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
2024-04-16 17:32:16 +08:00
hoshi-hiyouga c9828f4c6e
Update utils.py 2024-04-16 17:30:12 +08:00
hoshi-hiyouga 6700a1b9fa
Update trainer.py 2024-04-16 17:29:52 +08:00
hoshi-hiyouga 38a56706e0
Update utils.py 2024-04-16 17:29:30 +08:00
hoshi-hiyouga a950f3b81d
Update patcher.py 2024-04-16 17:29:19 +08:00
hoshi-hiyouga 750cdf2e74
Update adapter.py 2024-04-16 17:28:12 +08:00
hoshi-hiyouga 4660703674
Update parser.py 2024-04-16 17:27:25 +08:00
hoshi-hiyouga 5b59ff4212
Update parser.py 2024-04-16 17:27:02 +08:00
hoshi-hiyouga ec899cccf3
Update finetuning_args.py 2024-04-16 17:26:30 +08:00
hoshi-hiyouga 57dcd91e17
Update sft.sh 2024-04-16 17:25:40 +08:00
hoshi-hiyouga 50ced257e0
Update requirements.txt 2024-04-16 17:10:17 +08:00
hoshi-hiyouga f4b4a26c64
Update setup.py 2024-04-16 17:10:02 +08:00
Jonery 86900210d3 remove badam from core requirements 2024-04-16 12:25:50 +08:00
Jonery 7ecb61822b resolve gradient checkpointing issue. 2024-04-16 12:05:27 +08:00
codingma 62294289dc add check 2024-04-16 10:56:39 +08:00
codingma 75aa6392e8 support for previewing custom dataset in directory format 2024-04-16 10:43:14 +08:00
hiyouga b3ac14ffc4 add empty template 2024-04-16 03:10:02 +08:00
hiyouga cf52911fed update readme 2024-04-16 02:36:54 +08:00
hiyouga 6084eb7cf1 update readme 2024-04-16 02:35:36 +08:00
hiyouga 7dc72fb58c support unsloth 2024.4 2024-04-16 00:25:03 +08:00
hiyouga 6543f3d449 add codegemma 2024-04-16 00:11:15 +08:00
hiyouga e0dbac2845 support cohere commandR #3184 2024-04-15 23:26:42 +08:00
Jonery 06c8908d3f Feature BAdam 2024-04-15 23:15:27 +08:00
hoshi-hiyouga 7a8ae3f4ac
Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)
2024-04-15 22:59:35 +08:00
hoshi-hiyouga 3ccf0d0977
Update template.py 2024-04-15 22:58:01 +08:00
hoshi-hiyouga 268f53dddb
Update constants.py 2024-04-15 22:56:55 +08:00
hiyouga cce52351b5 update examples 2024-04-15 22:14:34 +08:00
marko1616 2c89b38720 change default_system accroding to official template 2024-04-15 20:45:46 +08:00
marko1616 90c5dddf9a Revert "Add support for function call(Not strictly following origin)"
This reverts commit d7b9bbc8b9.
2024-04-15 20:27:09 +08:00