p12475398
/
LLaMA-Factory-Mirror
forked from p04798526/LLaMA-Factory-Mirror
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,690 Commits 1 Branch 30 Tags 9.7 GiB
Commit Graph

1690 Commits

Author SHA1 Message Date
hiyouga c94e6c9411 add quant check in webui export tab 2024-06-13 03:19:18 +08:00
hiyouga a19cdd39fe Update llama3_full_sft_ds3.yaml 2024-06-13 03:16:20 +08:00
hiyouga b6e008c152 update examples 2024-06-13 03:15:06 +08:00
hiyouga 6baafd4eb3 fix #4221 2024-06-13 02:48:21 +08:00
hiyouga 9419f96609 update wechat 2024-06-13 02:31:45 +08:00
hiyouga cf9f2d6c42 fix #4209 
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
 2024-06-13 02:25:50 +08:00
hiyouga 2ed8270112 clean code 2024-06-13 01:58:16 +08:00
hoshi-hiyouga 1f23f25226
Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 
adapt vllm==0.5.0
 2024-06-13 01:54:02 +08:00
hiyouga c7a5620ccc add neo-sft dataset 2024-06-13 01:00:56 +08:00
hiyouga 713fde4259 fix lint 2024-06-13 00:48:44 +08:00
hiyouga 947a34f53b fix docker compose usage 2024-06-13 00:07:48 +08:00
hzhaoy 8fb6366ebe adapt vllm==0.5.0 2024-06-12 18:29:03 +08:00
hiyouga 2ce2e5bc47 update readme 2024-06-12 17:39:12 +08:00
hiyouga 577de2fa07 fix #4242 2024-06-12 16:50:11 +08:00
hoshi-hiyouga 656b2bbdaf
Merge pull request #4234 from kimdwkimdw/patch-1 
Support vllm==0.5.0
 2024-06-12 16:39:09 +08:00
Arthur Kim d65a3f7cb6
Support vllm==0.5.0 2024-06-12 16:49:12 +09:00
codingma 557891debb update wechat_npu.jpg 2024-06-12 10:39:05 +08:00
hoshi-hiyouga 9049aab911
Merge pull request #4204 from dignfei/main 
fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束
 2024-06-11 17:06:10 +08:00
hoshi-hiyouga 0c29233237
Update pretrain.py 2024-06-11 17:02:14 +08:00
hiyouga cca6f35108 fix deepspeed version 2024-06-11 16:52:36 +08:00
d 6979f3f848 经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降 2024-06-11 16:23:40 +08:00
hiyouga 53b74361d3 Update bug-report.yml 2024-06-11 15:40:21 +08:00
hiyouga 89f2bd8c8c fix #4198 2024-06-11 15:38:38 +08:00
hiyouga 90e14a960d tiny fix 2024-06-11 12:48:53 +08:00
hoshi-hiyouga 796699f867
Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs 
Add MANIFEST.in so requirements.txt is present in sdist
 2024-06-11 10:41:15 +08:00
Alfredo Luque 5f7b3b3ff6 add manifest so requirements.txt in sdist 2024-06-11 00:07:06 +00:00
hiyouga 3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00
hiyouga 91e62a098f set dev version 2024-06-11 00:50:53 +08:00
hiyouga 2b6ebd6b51 release v0.8.1 2024-06-11 00:44:26 +08:00
hiyouga a793e8456b fix #4160 
The split heads should be concatenated in dim=2
 2024-06-11 00:37:17 +08:00
hiyouga 949e9908ad fix #4145 
Fix the docker image
 2024-06-11 00:19:17 +08:00
hiyouga 0012762b04 update evaluator 2024-06-10 23:56:00 +08:00
hiyouga c907d81667 fix #2666 2024-06-10 21:24:15 +08:00
hoshi-hiyouga ef4afdaf0e
Merge pull request #4167 from yzoaim/branch 
fix README
 2024-06-10 16:24:33 +08:00
-.- 483cdd9b6a fix README 2024-06-08 23:51:56 +08:00
hiyouga b61d25cd70 add pr ci 2024-06-08 21:25:35 +08:00
hiyouga 25c635ef28 Update tests.yml 2024-06-08 21:15:36 +08:00
hiyouga 4c4f950f39 update git workflows 2024-06-08 21:11:32 +08:00
hiyouga 972ec9c668 fix llamafactory-cli env 2024-06-08 07:15:45 +08:00
hiyouga 3ac11e77cc set dev version 2024-06-08 06:46:09 +08:00
hiyouga 5aa4ce4756 release v0.8.0 2024-06-08 05:20:54 +08:00
hiyouga 12d79f89c5 add ultrafeedback and fineweb #4085 #4132 2024-06-08 02:42:34 +08:00
hiyouga 42d9b26fc8 fix ci 2024-06-08 02:00:44 +08:00
hiyouga 7f20e4722a fix ci 2024-06-08 01:57:36 +08:00
hiyouga aa2578bea0 add ci 2024-06-08 01:48:30 +08:00
hiyouga 1c7f0ab519 init unittest 2024-06-08 01:35:58 +08:00
hiyouga 4b55f35662 Delete .readthedocs.yaml 2024-06-08 00:58:10 +08:00
hiyouga 54cd743ebf reorganize adapter code 2024-06-08 00:47:23 +08:00
hoshi-hiyouga cfd62283a9
fix #4139 2024-06-08 00:45:02 +08:00
hiyouga 06e5d136a4 add resume args in webui 2024-06-08 00:22:16 +08:00