hiyouga
|
f1aa6a411a
|
fix #4271
|
2024-06-15 05:11:33 +08:00 |
|
hiyouga
|
d519b4d76d
|
disable DP
|
2024-06-15 04:57:19 +08:00 |
|
hiyouga
|
9092f963db
|
fix #4292
|
2024-06-15 04:47:13 +08:00 |
|
hiyouga
|
78589cf90c
|
fix #4295
|
2024-06-15 04:34:55 +08:00 |
|
hiyouga
|
b27269bd2b
|
add test cases
|
2024-06-15 04:05:54 +08:00 |
|
hiyouga
|
2d43b8bb49
|
Update README.md
|
2024-06-13 16:02:21 +08:00 |
|
hiyouga
|
892e561c28
|
update examples
|
2024-06-13 03:26:10 +08:00 |
|
hiyouga
|
c94e6c9411
|
add quant check in webui export tab
|
2024-06-13 03:19:18 +08:00 |
|
hiyouga
|
a19cdd39fe
|
Update llama3_full_sft_ds3.yaml
|
2024-06-13 03:16:20 +08:00 |
|
hiyouga
|
b6e008c152
|
update examples
|
2024-06-13 03:15:06 +08:00 |
|
hiyouga
|
6baafd4eb3
|
fix #4221
|
2024-06-13 02:48:21 +08:00 |
|
hiyouga
|
9419f96609
|
update wechat
|
2024-06-13 02:31:45 +08:00 |
|
hiyouga
|
cf9f2d6c42
|
fix #4209
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
|
2024-06-13 02:25:50 +08:00 |
|
hiyouga
|
2ed8270112
|
clean code
|
2024-06-13 01:58:16 +08:00 |
|
hoshi-hiyouga
|
1f23f25226
|
Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0
adapt vllm==0.5.0
|
2024-06-13 01:54:02 +08:00 |
|
hiyouga
|
c7a5620ccc
|
add neo-sft dataset
|
2024-06-13 01:00:56 +08:00 |
|
hiyouga
|
713fde4259
|
fix lint
|
2024-06-13 00:48:44 +08:00 |
|
hiyouga
|
947a34f53b
|
fix docker compose usage
|
2024-06-13 00:07:48 +08:00 |
|
hzhaoy
|
8fb6366ebe
|
adapt vllm==0.5.0
|
2024-06-12 18:29:03 +08:00 |
|
hiyouga
|
2ce2e5bc47
|
update readme
|
2024-06-12 17:39:12 +08:00 |
|
hiyouga
|
577de2fa07
|
fix #4242
|
2024-06-12 16:50:11 +08:00 |
|
hoshi-hiyouga
|
656b2bbdaf
|
Merge pull request #4234 from kimdwkimdw/patch-1
Support vllm==0.5.0
|
2024-06-12 16:39:09 +08:00 |
|
Arthur Kim
|
d65a3f7cb6
|
Support vllm==0.5.0
|
2024-06-12 16:49:12 +09:00 |
|
codingma
|
557891debb
|
update wechat_npu.jpg
|
2024-06-12 10:39:05 +08:00 |
|
hoshi-hiyouga
|
9049aab911
|
Merge pull request #4204 from dignfei/main
fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束
|
2024-06-11 17:06:10 +08:00 |
|
hoshi-hiyouga
|
0c29233237
|
Update pretrain.py
|
2024-06-11 17:02:14 +08:00 |
|
hiyouga
|
cca6f35108
|
fix deepspeed version
|
2024-06-11 16:52:36 +08:00 |
|
d
|
6979f3f848
|
经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降
|
2024-06-11 16:23:40 +08:00 |
|
hiyouga
|
53b74361d3
|
Update bug-report.yml
|
2024-06-11 15:40:21 +08:00 |
|
hiyouga
|
89f2bd8c8c
|
fix #4198
|
2024-06-11 15:38:38 +08:00 |
|
hiyouga
|
90e14a960d
|
tiny fix
|
2024-06-11 12:48:53 +08:00 |
|
hoshi-hiyouga
|
796699f867
|
Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs
Add MANIFEST.in so requirements.txt is present in sdist
|
2024-06-11 10:41:15 +08:00 |
|
Alfredo Luque
|
5f7b3b3ff6
|
add manifest so requirements.txt in sdist
|
2024-06-11 00:07:06 +00:00 |
|
hiyouga
|
3f24337a8a
|
tiny fix
|
2024-06-11 01:04:16 +08:00 |
|
hiyouga
|
91e62a098f
|
set dev version
|
2024-06-11 00:50:53 +08:00 |
|
hiyouga
|
2b6ebd6b51
|
release v0.8.1
|
2024-06-11 00:44:26 +08:00 |
|
hiyouga
|
a793e8456b
|
fix #4160
The split heads should be concatenated in dim=2
|
2024-06-11 00:37:17 +08:00 |
|
hiyouga
|
949e9908ad
|
fix #4145
Fix the docker image
|
2024-06-11 00:19:17 +08:00 |
|
hiyouga
|
0012762b04
|
update evaluator
|
2024-06-10 23:56:00 +08:00 |
|
hiyouga
|
c907d81667
|
fix #2666
|
2024-06-10 21:24:15 +08:00 |
|
hoshi-hiyouga
|
ef4afdaf0e
|
Merge pull request #4167 from yzoaim/branch
fix README
|
2024-06-10 16:24:33 +08:00 |
|
-.-
|
483cdd9b6a
|
fix README
|
2024-06-08 23:51:56 +08:00 |
|
hiyouga
|
b61d25cd70
|
add pr ci
|
2024-06-08 21:25:35 +08:00 |
|
hiyouga
|
25c635ef28
|
Update tests.yml
|
2024-06-08 21:15:36 +08:00 |
|
hiyouga
|
4c4f950f39
|
update git workflows
|
2024-06-08 21:11:32 +08:00 |
|
hiyouga
|
972ec9c668
|
fix llamafactory-cli env
|
2024-06-08 07:15:45 +08:00 |
|
hiyouga
|
3ac11e77cc
|
set dev version
|
2024-06-08 06:46:09 +08:00 |
|
hiyouga
|
5aa4ce4756
|
release v0.8.0
|
2024-06-08 05:20:54 +08:00 |
|
hiyouga
|
12d79f89c5
|
add ultrafeedback and fineweb #4085 #4132
|
2024-06-08 02:42:34 +08:00 |
|
hiyouga
|
42d9b26fc8
|
fix ci
|
2024-06-08 02:00:44 +08:00 |