Commit Graph

1285 Commits

Author SHA1 Message Date
hiyouga e3d8fc75eb support badam for all stages 2024-04-16 17:44:48 +08:00
hoshi-hiyouga 4d660c5ade
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
2024-04-16 17:32:16 +08:00
hoshi-hiyouga c9828f4c6e
Update utils.py 2024-04-16 17:30:12 +08:00
hoshi-hiyouga 6700a1b9fa
Update trainer.py 2024-04-16 17:29:52 +08:00
hoshi-hiyouga 38a56706e0
Update utils.py 2024-04-16 17:29:30 +08:00
hoshi-hiyouga a950f3b81d
Update patcher.py 2024-04-16 17:29:19 +08:00
hoshi-hiyouga 750cdf2e74
Update adapter.py 2024-04-16 17:28:12 +08:00
hoshi-hiyouga 4660703674
Update parser.py 2024-04-16 17:27:25 +08:00
hoshi-hiyouga 5b59ff4212
Update parser.py 2024-04-16 17:27:02 +08:00
hoshi-hiyouga ec899cccf3
Update finetuning_args.py 2024-04-16 17:26:30 +08:00
hoshi-hiyouga 57dcd91e17
Update sft.sh 2024-04-16 17:25:40 +08:00
hoshi-hiyouga 50ced257e0
Update requirements.txt 2024-04-16 17:10:17 +08:00
hoshi-hiyouga f4b4a26c64
Update setup.py 2024-04-16 17:10:02 +08:00
Jonery 86900210d3 remove badam from core requirements 2024-04-16 12:25:50 +08:00
Jonery 7ecb61822b resolve gradient checkpointing issue. 2024-04-16 12:05:27 +08:00
codingma 62294289dc add check 2024-04-16 10:56:39 +08:00
codingma 75aa6392e8 support for previewing custom dataset in directory format 2024-04-16 10:43:14 +08:00
hiyouga b3ac14ffc4 add empty template 2024-04-16 03:10:02 +08:00
hiyouga cf52911fed update readme 2024-04-16 02:36:54 +08:00
hiyouga 6084eb7cf1 update readme 2024-04-16 02:35:36 +08:00
hiyouga 7dc72fb58c support unsloth 2024.4 2024-04-16 00:25:03 +08:00
hiyouga 6543f3d449 add codegemma 2024-04-16 00:11:15 +08:00
hiyouga e0dbac2845 support cohere commandR #3184 2024-04-15 23:26:42 +08:00
Jonery 06c8908d3f Feature BAdam 2024-04-15 23:15:27 +08:00
hoshi-hiyouga 7a8ae3f4ac
Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)
2024-04-15 22:59:35 +08:00
hoshi-hiyouga 3ccf0d0977
Update template.py 2024-04-15 22:58:01 +08:00
hoshi-hiyouga 268f53dddb
Update constants.py 2024-04-15 22:56:55 +08:00
hiyouga cce52351b5 update examples 2024-04-15 22:14:34 +08:00
marko1616 2c89b38720 change default_system accroding to official template 2024-04-15 20:45:46 +08:00
marko1616 90c5dddf9a Revert "Add support for function call(Not strictly following origin)"
This reverts commit d7b9bbc8b9.
2024-04-15 20:27:09 +08:00
marko1616 d7b9bbc8b9 Add support for function call(Not strictly following origin) 2024-04-15 20:16:52 +08:00
hoshi-hiyouga 09735ed30c
Merge pull request #3261 from khazic/main
Added specimens for single-card full parameter prediction
2024-04-15 16:30:57 +08:00
hoshi-hiyouga 0e0942d388
Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
2024-04-15 15:38:16 +08:00
hiyouga efc345c4b0 fix #3273 2024-04-15 15:32:58 +08:00
liuzc 9f4fe62386 fix: mixtral output_router_logits 2024-04-15 12:11:49 +08:00
khazic fe5d3bb8f0 Upgrade README.md 2024-04-13 20:50:49 +08:00
khazic 47111ce506 Added specimens for single-card full parameter prediction 2024-04-13 20:45:19 +08:00
marko1616 ab033dac4f Typo fix 2024-04-13 17:30:21 +08:00
marko1616 42806323f0 Typo fix 2024-04-13 07:52:11 +08:00
marko1616 d0705518ee Add c4ai-command-r-plus link 2024-04-13 07:32:40 +08:00
marko1616 6574a721d2 Add template&support(Not tested) 2024-04-13 04:31:33 +08:00
hiyouga d1fb6c72b5 fix #3247 2024-04-12 17:41:33 +08:00
hiyouga c53a11b6fd fix model card 2024-04-12 17:11:59 +08:00
hiyouga 232642a621 fix #3238 2024-04-12 14:28:11 +08:00
hiyouga f2ba59352e Update wechat.jpg 2024-04-12 14:15:45 +08:00
hiyouga 3dfe4cf611 set dev version 2024-04-11 20:27:34 +08:00
hiyouga 9d4c949461 release v0.6.2 2024-04-11 20:08:51 +08:00
hiyouga 51d0a1a19e Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-04-10 23:58:18 +08:00
hiyouga a99f5ed0b6 fix #3225 2024-04-10 23:57:59 +08:00
hoshi-hiyouga caf8373c2d
Merge pull request #3201 from kno10/patch-1 and fix #3200
Pass additional_target to unsloth
2024-04-10 00:58:48 +08:00