hiyouga
06c97083e1
fix #2803
2024-03-12 16:57:39 +08:00
hiyouga
07f9b754a7
fix #2782 #2798
2024-03-12 15:53:29 +08:00
hoshi-hiyouga
c901aa63ff
Merge pull request #2743 from S3Studio/DockerizeSupport
...
Add dockerize support
2024-03-12 00:05:49 +08:00
hiyouga
e874c00906
fix #2775
2024-03-11 00:42:54 +08:00
hiyouga
352693e2dc
tiny fix
2024-03-11 00:17:18 +08:00
hiyouga
be99799413
update parser
2024-03-10 13:35:20 +08:00
hiyouga
8664262cde
support layerwise galore
2024-03-10 00:24:11 +08:00
hiyouga
18ffce36b5
fix #2732
2024-03-09 22:37:16 +08:00
hiyouga
bdb496644c
allow non-packing pretraining
2024-03-09 22:21:46 +08:00
hiyouga
412c52e325
fix #2766
2024-03-09 21:35:24 +08:00
hiyouga
af0e370fb1
use default arg for freeze tuning
2024-03-09 06:08:48 +08:00
hiyouga
818726e9bc
add GaLore results
2024-03-09 04:11:55 +08:00
hiyouga
393c2de27c
update hardware requirements
2024-03-09 03:58:18 +08:00
hiyouga
4c00bcdcae
update examples
2024-03-09 02:30:37 +08:00
hiyouga
e8dd38b7fd
fix #2756 , patch #2746
2024-03-09 02:01:26 +08:00
hoshi-hiyouga
516d0ddc66
Merge pull request #2746 from stephen-nju/main
...
fix deepspeed ppo RuntimeError
2024-03-09 01:37:00 +08:00
hiyouga
74ff8664d7
Update setup.py
2024-03-09 00:14:48 +08:00
hiyouga
10be2f0ecc
fix aqlm version
2024-03-09 00:09:09 +08:00
hiyouga
8a45213440
fix example params
2024-03-08 20:41:43 +08:00
stephen_zhu
aa71571b77
update
2024-03-08 12:47:44 +08:00
stephen
cdb7f82869
fix ppo runtime error
2024-03-08 11:48:26 +08:00
S3Studio
3d911ae713
Add dockerize support
...
Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure.
2024-03-08 10:47:28 +08:00
hiyouga
4a2cc60b94
update readme
2024-03-08 03:06:21 +08:00
hiyouga
5d956e2a51
fix chat engine, update webui
2024-03-08 03:01:53 +08:00
hiyouga
5cd4947650
Update setup.py
2024-03-08 01:23:00 +08:00
hiyouga
0ac6b40a47
update galore args
2024-03-08 01:17:32 +08:00
hiyouga
33a4c24a8a
fix galore
2024-03-08 00:44:51 +08:00
hiyouga
57452a4aa1
add Yi-9B model
2024-03-07 23:11:57 +08:00
hiyouga
7230e1177d
add galore examples
2024-03-07 22:53:45 +08:00
hiyouga
28f7862188
support galore
2024-03-07 22:41:36 +08:00
hiyouga
725f7cd70f
update readme
2024-03-07 20:34:49 +08:00
hiyouga
77211d9843
tiny fix
2024-03-07 20:29:34 +08:00
hoshi-hiyouga
a0dc721816
Merge pull request #2739 from hiyouga/dev-vllm
...
support vllm
2024-03-07 20:28:18 +08:00
hiyouga
d07ad5cc1c
support vllm
2024-03-07 20:26:31 +08:00
hiyouga
f74f804a71
fix #2735
2024-03-07 16:15:53 +08:00
hoshi-hiyouga
2185855bdb
Merge pull request #2730 from cx2333-gt/main
...
fix flash_attn in train_web
2024-03-07 14:37:18 +08:00
cx2333
94b7a1b915
revert choice name
2024-03-07 14:28:55 +08:00
hiyouga
921ee82267
fix chatglm3 template
2024-03-07 14:26:16 +08:00
hiyouga
08d7dc06f2
Update wechat.jpg
2024-03-07 13:14:10 +08:00
cx2333
a8889498fa
fix flash_attn in train_web
2024-03-07 10:13:55 +08:00
hiyouga
0048a2021e
tiny fix
2024-03-06 17:25:08 +08:00
hiyouga
3e84f430b1
export use balanced gpu
2024-03-06 16:33:14 +08:00
hiyouga
9658c63cd9
fix add tokens
2024-03-06 15:04:02 +08:00
hiyouga
3016e65657
fix version checking
2024-03-06 14:51:51 +08:00
hiyouga
d1587c80de
update examples
2024-03-06 13:14:57 +08:00
hiyouga
e0c47358f9
fix arg dtype
2024-03-05 20:53:30 +08:00
hiyouga
259af60d28
improve aqlm optim
2024-03-05 20:49:50 +08:00
hiyouga
d3d3dac707
optimize aqlm training
2024-03-05 18:35:41 +08:00
hiyouga
ddf352f861
fix dora inference
2024-03-05 11:51:41 +08:00
hiyouga
e5edcf440f
fix export model
2024-03-05 11:05:41 +08:00