p12475398
/
LLaMA-Factory-Mirror
forked from p04798526/LLaMA-Factory-Mirror
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,713 Commits 1 Branch 30 Tags 9.7 GiB
Commit Graph

1713 Commits

Author SHA1 Message Date
hiyouga e2665e71c7 fix #4326 2024-06-17 18:17:48 +08:00
hiyouga 72471ee046 Update wechat.jpg 2024-06-17 17:49:03 +08:00
hiyouga 2bf2863a58 tiny fix 2024-06-17 17:47:25 +08:00
hoshi-hiyouga 29c1f31baa
Update parser.py 2024-06-16 02:57:00 +08:00
hiyouga 0a2ec5fe20 update pr template 2024-06-16 01:43:43 +08:00
hoshi-hiyouga b7b5892a34
Merge pull request #4307 from hiyouga/pissa 
Support pissa
 2024-06-16 01:41:50 +08:00
hiyouga 46093b5786 fix tol 2024-06-16 01:38:44 +08:00
hiyouga 7f3c19e3ab Update tests.yml 2024-06-16 01:22:23 +08:00
hiyouga de43bee0b0 increase tol 2024-06-16 01:21:06 +08:00
hiyouga 8c1046d78a support pissa 2024-06-16 01:08:12 +08:00
hiyouga 38b6b0f52e tiny fix 2024-06-16 01:06:41 +08:00
hiyouga 80a9e6bf94 use fixture 2024-06-15 20:06:17 +08:00
hiyouga 1b834f50be add tests 2024-06-15 19:51:20 +08:00
hiyouga 572d8bbfdd add minicpm #4227 2024-06-15 17:58:52 +08:00
hiyouga d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga acd84ce535 update readme 2024-06-15 05:13:16 +08:00
hiyouga f1aa6a411a fix #4271 2024-06-15 05:11:33 +08:00
hiyouga d519b4d76d disable DP 2024-06-15 04:57:19 +08:00
hiyouga 9092f963db fix #4292 2024-06-15 04:47:13 +08:00
hiyouga 78589cf90c fix #4295 2024-06-15 04:34:55 +08:00
hiyouga b27269bd2b add test cases 2024-06-15 04:05:54 +08:00
hiyouga 2d43b8bb49 Update README.md 2024-06-13 16:02:21 +08:00
hiyouga 892e561c28 update examples 2024-06-13 03:26:10 +08:00
hiyouga c94e6c9411 add quant check in webui export tab 2024-06-13 03:19:18 +08:00
hiyouga a19cdd39fe Update llama3_full_sft_ds3.yaml 2024-06-13 03:16:20 +08:00
hiyouga b6e008c152 update examples 2024-06-13 03:15:06 +08:00
hiyouga 6baafd4eb3 fix #4221 2024-06-13 02:48:21 +08:00
hiyouga 9419f96609 update wechat 2024-06-13 02:31:45 +08:00
hiyouga cf9f2d6c42 fix #4209 
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
 2024-06-13 02:25:50 +08:00
hiyouga 2ed8270112 clean code 2024-06-13 01:58:16 +08:00
hoshi-hiyouga 1f23f25226
Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 
adapt vllm==0.5.0
 2024-06-13 01:54:02 +08:00
hiyouga c7a5620ccc add neo-sft dataset 2024-06-13 01:00:56 +08:00
hiyouga 713fde4259 fix lint 2024-06-13 00:48:44 +08:00
hiyouga 947a34f53b fix docker compose usage 2024-06-13 00:07:48 +08:00
hzhaoy 8fb6366ebe adapt vllm==0.5.0 2024-06-12 18:29:03 +08:00
hiyouga 2ce2e5bc47 update readme 2024-06-12 17:39:12 +08:00
hiyouga 577de2fa07 fix #4242 2024-06-12 16:50:11 +08:00
hoshi-hiyouga 656b2bbdaf
Merge pull request #4234 from kimdwkimdw/patch-1 
Support vllm==0.5.0
 2024-06-12 16:39:09 +08:00
Arthur Kim d65a3f7cb6
Support vllm==0.5.0 2024-06-12 16:49:12 +09:00
codingma 557891debb update wechat_npu.jpg 2024-06-12 10:39:05 +08:00
hoshi-hiyouga 9049aab911
Merge pull request #4204 from dignfei/main 
fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束
 2024-06-11 17:06:10 +08:00
hoshi-hiyouga 0c29233237
Update pretrain.py 2024-06-11 17:02:14 +08:00
hiyouga cca6f35108 fix deepspeed version 2024-06-11 16:52:36 +08:00
d 6979f3f848 经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降 2024-06-11 16:23:40 +08:00
hiyouga 53b74361d3 Update bug-report.yml 2024-06-11 15:40:21 +08:00
hiyouga 89f2bd8c8c fix #4198 2024-06-11 15:38:38 +08:00
hiyouga 90e14a960d tiny fix 2024-06-11 12:48:53 +08:00
hoshi-hiyouga 796699f867
Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs 
Add MANIFEST.in so requirements.txt is present in sdist
 2024-06-11 10:41:15 +08:00
Alfredo Luque 5f7b3b3ff6 add manifest so requirements.txt in sdist 2024-06-11 00:07:06 +00:00
hiyouga 3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00