hiyouga
|
4469a3237d
|
fix #3366
|
2024-04-21 21:34:25 +08:00 |
|
hiyouga
|
fbbe0dba2f
|
fix optimizers
|
2024-04-21 20:40:54 +08:00 |
|
hiyouga
|
a1d31ffc8c
|
fix #3365
|
2024-04-21 19:20:18 +08:00 |
|
hiyouga
|
5c62881c5a
|
fix bug in galore optimizer
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
f58425ab45
|
fix mod stuff
|
2024-04-21 18:11:10 +08:00 |
|
hoshi-hiyouga
|
d0273787be
|
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
|
2024-04-21 18:05:52 +08:00 |
|
hoshi-hiyouga
|
1fa287fd63
|
fix #3348
|
2024-04-20 10:34:09 +08:00 |
|
hiyouga
|
6339edefff
|
add dpo mix dataset
|
2024-04-20 01:31:38 +08:00 |
|
hiyouga
|
ba559a659a
|
fix #3352
|
2024-04-19 22:40:01 +08:00 |
|
hiyouga
|
14a605a2da
|
fix llama3 template
|
2024-04-19 15:46:51 +08:00 |
|
Marco
|
4fb7e046b3
|
fix small typo
|
2024-04-18 20:33:29 +02:00 |
|
Marco
|
620add7b9f
|
Added Mixture of Depths
|
2024-04-18 20:31:24 +02:00 |
|
hoshi-hiyouga
|
2aaaede247
|
support llama3
|
2024-04-19 01:13:50 +08:00 |
|
hiyouga
|
942362d008
|
fix #3324
|
2024-04-18 15:34:45 +08:00 |
|
hiyouga
|
3b43a3b7c5
|
tiny fix
|
2024-04-18 00:22:17 +08:00 |
|
hiyouga
|
e2f1c6fc6a
|
update readme
|
2024-04-17 23:40:49 +08:00 |
|
hiyouga
|
cab0598fd0
|
add mixtral 8x22B models
|
2024-04-17 23:35:59 +08:00 |
|
hiyouga
|
5f86053d75
|
add CodeQwen models
|
2024-04-17 23:27:22 +08:00 |
|
hiyouga
|
c9a477322d
|
fix #3316
|
2024-04-17 22:54:34 +08:00 |
|
hiyouga
|
6d641af703
|
fix #3317
|
2024-04-17 22:17:19 +08:00 |
|
hiyouga
|
e3ca57602c
|
Update wechat.jpg
|
2024-04-17 21:14:37 +08:00 |
|
hiyouga
|
278c5e10c4
|
lint
|
2024-04-16 18:21:09 +08:00 |
|
hoshi-hiyouga
|
aa3206ec26
|
Merge pull request #3291 from codemayq/main
support for previewing custom dataset in directory format
|
2024-04-16 18:12:09 +08:00 |
|
hiyouga
|
c00f0771a5
|
Update parser.py
|
2024-04-16 18:09:31 +08:00 |
|
hiyouga
|
5d62a51c12
|
update readme and gradio version
|
2024-04-16 18:09:16 +08:00 |
|
hiyouga
|
e3d8fc75eb
|
support badam for all stages
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
4d660c5ade
|
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
|
2024-04-16 17:32:16 +08:00 |
|
hoshi-hiyouga
|
c9828f4c6e
|
Update utils.py
|
2024-04-16 17:30:12 +08:00 |
|
hoshi-hiyouga
|
6700a1b9fa
|
Update trainer.py
|
2024-04-16 17:29:52 +08:00 |
|
hoshi-hiyouga
|
38a56706e0
|
Update utils.py
|
2024-04-16 17:29:30 +08:00 |
|
hoshi-hiyouga
|
a950f3b81d
|
Update patcher.py
|
2024-04-16 17:29:19 +08:00 |
|
hoshi-hiyouga
|
750cdf2e74
|
Update adapter.py
|
2024-04-16 17:28:12 +08:00 |
|
hoshi-hiyouga
|
4660703674
|
Update parser.py
|
2024-04-16 17:27:25 +08:00 |
|
hoshi-hiyouga
|
5b59ff4212
|
Update parser.py
|
2024-04-16 17:27:02 +08:00 |
|
hoshi-hiyouga
|
ec899cccf3
|
Update finetuning_args.py
|
2024-04-16 17:26:30 +08:00 |
|
hoshi-hiyouga
|
57dcd91e17
|
Update sft.sh
|
2024-04-16 17:25:40 +08:00 |
|
hoshi-hiyouga
|
50ced257e0
|
Update requirements.txt
|
2024-04-16 17:10:17 +08:00 |
|
hoshi-hiyouga
|
f4b4a26c64
|
Update setup.py
|
2024-04-16 17:10:02 +08:00 |
|
Jonery
|
86900210d3
|
remove badam from core requirements
|
2024-04-16 12:25:50 +08:00 |
|
Jonery
|
7ecb61822b
|
resolve gradient checkpointing issue.
|
2024-04-16 12:05:27 +08:00 |
|
codingma
|
62294289dc
|
add check
|
2024-04-16 10:56:39 +08:00 |
|
codingma
|
75aa6392e8
|
support for previewing custom dataset in directory format
|
2024-04-16 10:43:14 +08:00 |
|
hiyouga
|
b3ac14ffc4
|
add empty template
|
2024-04-16 03:10:02 +08:00 |
|
hiyouga
|
cf52911fed
|
update readme
|
2024-04-16 02:36:54 +08:00 |
|
hiyouga
|
6084eb7cf1
|
update readme
|
2024-04-16 02:35:36 +08:00 |
|
hiyouga
|
7dc72fb58c
|
support unsloth 2024.4
|
2024-04-16 00:25:03 +08:00 |
|
hiyouga
|
6543f3d449
|
add codegemma
|
2024-04-16 00:11:15 +08:00 |
|
hiyouga
|
e0dbac2845
|
support cohere commandR #3184
|
2024-04-15 23:26:42 +08:00 |
|
Jonery
|
06c8908d3f
|
Feature BAdam
|
2024-04-15 23:15:27 +08:00 |
|
hoshi-hiyouga
|
7a8ae3f4ac
|
Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)
|
2024-04-15 22:59:35 +08:00 |