1797 Commits

All Branches

Search

Author	SHA1	Message	Date
hiyouga	b27269bd2b	add test cases	2024-06-15 04:05:54 +08:00
hiyouga	2d43b8bb49	Update README.md	2024-06-13 16:02:21 +08:00
hiyouga	892e561c28	update examples	2024-06-13 03:26:10 +08:00
hiyouga	c94e6c9411	add quant check in webui export tab	2024-06-13 03:19:18 +08:00
hiyouga	a19cdd39fe	Update llama3_full_sft_ds3.yaml	2024-06-13 03:16:20 +08:00
hiyouga	b6e008c152	update examples	2024-06-13 03:15:06 +08:00
hiyouga	6baafd4eb3	fix #4221	2024-06-13 02:48:21 +08:00
hiyouga	9419f96609	update wechat	2024-06-13 02:31:45 +08:00
hiyouga	cf9f2d6c42	fix #4209 ... DeepSpeed ZeRO3 has inflight param error when calling model.eval()	2024-06-13 02:25:50 +08:00
hiyouga	2ed8270112	clean code	2024-06-13 01:58:16 +08:00
hoshi-hiyouga	1f23f25226	Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 ... adapt vllm==0.5.0	2024-06-13 01:54:02 +08:00
hiyouga	c7a5620ccc	add neo-sft dataset	2024-06-13 01:00:56 +08:00
hiyouga	713fde4259	fix lint	2024-06-13 00:48:44 +08:00
hiyouga	947a34f53b	fix docker compose usage	2024-06-13 00:07:48 +08:00
hzhaoy	8fb6366ebe	adapt vllm==0.5.0	2024-06-12 18:29:03 +08:00
hiyouga	2ce2e5bc47	update readme	2024-06-12 17:39:12 +08:00
hiyouga	577de2fa07	fix #4242	2024-06-12 16:50:11 +08:00
hoshi-hiyouga	656b2bbdaf	Merge pull request #4234 from kimdwkimdw/patch-1 ... Support vllm==0.5.0	2024-06-12 16:39:09 +08:00
Arthur Kim	d65a3f7cb6	Support vllm==0.5.0	2024-06-12 16:49:12 +09:00
codingma	557891debb	update wechat_npu.jpg	2024-06-12 10:39:05 +08:00
hoshi-hiyouga	9049aab911	Merge pull request #4204 from dignfei/main ... fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束	2024-06-11 17:06:10 +08:00
hoshi-hiyouga	0c29233237	Update pretrain.py	2024-06-11 17:02:14 +08:00
hiyouga	cca6f35108	fix deepspeed version	2024-06-11 16:52:36 +08:00
d	6979f3f848	经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降	2024-06-11 16:23:40 +08:00
hiyouga	53b74361d3	Update bug-report.yml	2024-06-11 15:40:21 +08:00
hiyouga	89f2bd8c8c	fix #4198	2024-06-11 15:38:38 +08:00
hiyouga	90e14a960d	tiny fix	2024-06-11 12:48:53 +08:00
hoshi-hiyouga	796699f867	Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs ... Add MANIFEST.in so requirements.txt is present in sdist	2024-06-11 10:41:15 +08:00
Alfredo Luque	5f7b3b3ff6	add manifest so requirements.txt in sdist	2024-06-11 00:07:06 +00:00
hiyouga	3f24337a8a	tiny fix	2024-06-11 01:04:16 +08:00
hiyouga	91e62a098f	set dev version	2024-06-11 00:50:53 +08:00
hiyouga	2b6ebd6b51	release v0.8.1	2024-06-11 00:44:26 +08:00
hiyouga	a793e8456b	fix #4160 ... The split heads should be concatenated in dim=2	2024-06-11 00:37:17 +08:00
hiyouga	949e9908ad	fix #4145 ... Fix the docker image	2024-06-11 00:19:17 +08:00
hiyouga	0012762b04	update evaluator	2024-06-10 23:56:00 +08:00
hiyouga	c907d81667	fix #2666	2024-06-10 21:24:15 +08:00
hoshi-hiyouga	ef4afdaf0e	Merge pull request #4167 from yzoaim/branch ... fix README	2024-06-10 16:24:33 +08:00
mMrBun	950e360ca0	Optimize the handling of QWEN2 in scenarios involving multiple tool calls.	2024-06-10 02:00:14 +08:00
mMrBun	6ed0b0c800	Removed unnecessary comments.	2024-06-09 18:25:22 +08:00
mMrBun	0f2609ce19	Merge branch 'hiyouga:main' into main	2024-06-09 18:17:24 +08:00
mMrBun	cb1cbcb293	Implemented the tool_formatter and tool_extractor for glm4 tool_format	2024-06-09 18:16:15 +08:00
-.-	483cdd9b6a	fix README	2024-06-08 23:51:56 +08:00
hiyouga	b61d25cd70	add pr ci	2024-06-08 21:25:35 +08:00
hiyouga	25c635ef28	Update tests.yml	2024-06-08 21:15:36 +08:00
hiyouga	4c4f950f39	update git workflows	2024-06-08 21:11:32 +08:00
hiyouga	972ec9c668	fix llamafactory-cli env	2024-06-08 07:15:45 +08:00
hiyouga	3ac11e77cc	set dev version	2024-06-08 06:46:09 +08:00
hiyouga	5aa4ce4756	release v0.8.0	2024-06-08 05:20:54 +08:00
hiyouga	12d79f89c5	add ultrafeedback and fineweb #4085 #4132	2024-06-08 02:42:34 +08:00
hiyouga	42d9b26fc8	fix ci	2024-06-08 02:00:44 +08:00