p12475398
/
LLaMA-Factory-Mirror
forked from p04798526/LLaMA-Factory-Mirror
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,699 Commits 1 Branch 30 Tags 9.7 GiB
Commit Graph

1699 Commits

Author SHA1 Message Date
hiyouga d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga acd84ce535 update readme 2024-06-15 05:13:16 +08:00
hiyouga f1aa6a411a fix #4271 2024-06-15 05:11:33 +08:00
hiyouga d519b4d76d disable DP 2024-06-15 04:57:19 +08:00
hiyouga 9092f963db fix #4292 2024-06-15 04:47:13 +08:00
hiyouga 78589cf90c fix #4295 2024-06-15 04:34:55 +08:00
hiyouga b27269bd2b add test cases 2024-06-15 04:05:54 +08:00
hiyouga 2d43b8bb49 Update README.md 2024-06-13 16:02:21 +08:00
hiyouga 892e561c28 update examples 2024-06-13 03:26:10 +08:00
hiyouga c94e6c9411 add quant check in webui export tab 2024-06-13 03:19:18 +08:00
hiyouga a19cdd39fe Update llama3_full_sft_ds3.yaml 2024-06-13 03:16:20 +08:00
hiyouga b6e008c152 update examples 2024-06-13 03:15:06 +08:00
hiyouga 6baafd4eb3 fix #4221 2024-06-13 02:48:21 +08:00
hiyouga 9419f96609 update wechat 2024-06-13 02:31:45 +08:00
hiyouga cf9f2d6c42 fix #4209 
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
 2024-06-13 02:25:50 +08:00
hiyouga 2ed8270112 clean code 2024-06-13 01:58:16 +08:00
hoshi-hiyouga 1f23f25226
Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 
adapt vllm==0.5.0
 2024-06-13 01:54:02 +08:00
hiyouga c7a5620ccc add neo-sft dataset 2024-06-13 01:00:56 +08:00
hiyouga 713fde4259 fix lint 2024-06-13 00:48:44 +08:00
hiyouga 947a34f53b fix docker compose usage 2024-06-13 00:07:48 +08:00
hzhaoy 8fb6366ebe adapt vllm==0.5.0 2024-06-12 18:29:03 +08:00
hiyouga 2ce2e5bc47 update readme 2024-06-12 17:39:12 +08:00
hiyouga 577de2fa07 fix #4242 2024-06-12 16:50:11 +08:00
hoshi-hiyouga 656b2bbdaf
Merge pull request #4234 from kimdwkimdw/patch-1 
Support vllm==0.5.0
 2024-06-12 16:39:09 +08:00
Arthur Kim d65a3f7cb6
Support vllm==0.5.0 2024-06-12 16:49:12 +09:00
codingma 557891debb update wechat_npu.jpg 2024-06-12 10:39:05 +08:00
hoshi-hiyouga 9049aab911
Merge pull request #4204 from dignfei/main 
fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束
 2024-06-11 17:06:10 +08:00
hoshi-hiyouga 0c29233237
Update pretrain.py 2024-06-11 17:02:14 +08:00
hiyouga cca6f35108 fix deepspeed version 2024-06-11 16:52:36 +08:00
d 6979f3f848 经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降 2024-06-11 16:23:40 +08:00
hiyouga 53b74361d3 Update bug-report.yml 2024-06-11 15:40:21 +08:00
hiyouga 89f2bd8c8c fix #4198 2024-06-11 15:38:38 +08:00
hiyouga 90e14a960d tiny fix 2024-06-11 12:48:53 +08:00
hoshi-hiyouga 796699f867
Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs 
Add MANIFEST.in so requirements.txt is present in sdist
 2024-06-11 10:41:15 +08:00
Alfredo Luque 5f7b3b3ff6 add manifest so requirements.txt in sdist 2024-06-11 00:07:06 +00:00
hiyouga 3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00
hiyouga 91e62a098f set dev version 2024-06-11 00:50:53 +08:00
hiyouga 2b6ebd6b51 release v0.8.1 2024-06-11 00:44:26 +08:00
hiyouga a793e8456b fix #4160 
The split heads should be concatenated in dim=2
 2024-06-11 00:37:17 +08:00
hiyouga 949e9908ad fix #4145 
Fix the docker image
 2024-06-11 00:19:17 +08:00
hiyouga 0012762b04 update evaluator 2024-06-10 23:56:00 +08:00
hiyouga c907d81667 fix #2666 2024-06-10 21:24:15 +08:00
hoshi-hiyouga ef4afdaf0e
Merge pull request #4167 from yzoaim/branch 
fix README
 2024-06-10 16:24:33 +08:00
-.- 483cdd9b6a fix README 2024-06-08 23:51:56 +08:00
hiyouga b61d25cd70 add pr ci 2024-06-08 21:25:35 +08:00
hiyouga 25c635ef28 Update tests.yml 2024-06-08 21:15:36 +08:00
hiyouga 4c4f950f39 update git workflows 2024-06-08 21:11:32 +08:00
hiyouga 972ec9c668 fix llamafactory-cli env 2024-06-08 07:15:45 +08:00
hiyouga 3ac11e77cc set dev version 2024-06-08 06:46:09 +08:00
hiyouga 5aa4ce4756 release v0.8.0 2024-06-08 05:20:54 +08:00