Commit Graph

1494 Commits

Author SHA1 Message Date
hiyouga e55c85ac72 fix paligemma data preprocess 2024-05-20 23:51:32 +08:00
hiyouga 542229abb3 fix paligemma inference 2024-05-20 23:36:43 +08:00
hiyouga 7262679666 fix #3818 2024-05-20 21:43:19 +08:00
hiyouga 9b0f4d7602 add kto to webui 2024-05-20 21:20:25 +08:00
hiyouga d52fae2fa8 fix chat engines
do not use pop(key, default) since api assigns None to dict values
2024-05-20 00:36:43 +08:00
hoshi-hiyouga aa0bca49e9
Merge pull request #3812 from ycjcl868/feat/chat-support-system-prompt
feat: cli chat support system_message
2024-05-20 00:31:32 +08:00
hoshi-hiyouga a0e8d3d159
Update vllm_engine.py 2024-05-20 00:31:04 +08:00
hoshi-hiyouga a943a1034b
Update hf_engine.py 2024-05-20 00:30:45 +08:00
hoshi-hiyouga a1fa7aa63b
Update generating_args.py 2024-05-20 00:29:31 +08:00
hoshi-hiyouga 896c656185
Update chat_model.py 2024-05-20 00:29:12 +08:00
hiyouga 10573e1639 fix jinja template 2024-05-19 23:38:30 +08:00
ycjcl868 a08ba254c8 feat: cli chat support system_message 2024-05-19 23:17:46 +08:00
hiyouga 31a0564d4f fix zero2 high ram usage 2024-05-19 21:53:54 +08:00
hiyouga 70214b71b1 fix hf gen args 2024-05-19 19:39:32 +08:00
hiyouga 8ee8ac6eba fix envs 2024-05-19 18:27:18 +08:00
hiyouga 1ebc890a5f fix #3807 2024-05-19 17:07:57 +08:00
hiyouga 2bec28e328 update readme 2024-05-18 23:09:03 +08:00
hiyouga 3c2a992caa safe output path in webui 2024-05-18 22:42:28 +08:00
hiyouga d43822fcc2 fix jetmoe z3 block 2024-05-18 22:28:45 +08:00
hiyouga a851056229 improve data process logger 2024-05-18 22:02:42 +08:00
hiyouga ca48f90f1e update data readme 2024-05-18 21:37:38 +08:00
hiyouga 18cbf8561d update data readme 2024-05-18 21:15:20 +08:00
hiyouga 0edc16769f fix #3803 2024-05-18 16:13:14 +08:00
hoshi-hiyouga 73d4a8e655
Merge pull request #3799 from hiyouga/dev
improve KTO impl, replace datasets
2024-05-18 03:49:13 +08:00
hiyouga c450ee87a3 improve KTO impl., replace datasets 2024-05-18 03:44:56 +08:00
hoshi-hiyouga 33a354548e
Merge pull request #3785 from enji-zhou/feature/add_kto
add kto
2024-05-18 03:07:18 +08:00
hoshi-hiyouga d7ff49f245
Merge pull request #3794 from jue-jue-zi/main
feat: pass the `max_lora_rank` parameter to vLLM backend
2024-05-17 16:17:30 +08:00
hoshi-hiyouga 9646727453
Update model_args.py 2024-05-17 16:16:41 +08:00
juejuezi b20d62ba3c feat: pass the `max_lora_rank` parameter to vLLM backend 2024-05-17 16:07:39 +08:00
hiyouga 8af9817605 add deepseek v2 lite model 2024-05-17 13:25:36 +08:00
enji.zhou db1d5a4f51 add kto 2024-05-17 13:09:17 +08:00
hiyouga 84415492bf Update wechat.jpg 2024-05-17 12:18:03 +08:00
hiyouga e5bba7cf1b update badam example #3764 2024-05-17 02:21:10 +08:00
hiyouga d9f190ff1e better dtype handle in loading 2024-05-17 02:14:56 +08:00
hiyouga ddec9e1b84 update examples 2024-05-17 01:02:00 +08:00
hiyouga 694a05fd04 enable inbrowser in webui 2024-05-17 00:08:56 +08:00
hiyouga d77bed4091 add falcon 11b 2024-05-17 00:08:33 +08:00
hiyouga 3df986c679 fix examples #3769 2024-05-16 19:12:09 +08:00
hiyouga 308edbc426 rename package 2024-05-16 18:39:08 +08:00
hiyouga b2fc7aeb03 set dev version 2024-05-16 02:17:31 +08:00
hiyouga 1c910079d8 release v0.7.1 2024-05-16 00:57:16 +08:00
hiyouga 2a67ab3925 fix #3694 2024-05-16 00:35:28 +08:00
hiyouga 44cfa9a1cd fix #3606
https://github.com/huggingface/peft/pull/1706
2024-05-15 23:05:02 +08:00
hiyouga a388cadfc0 add Yi-VL-34B model 2024-05-15 22:58:19 +08:00
hiyouga 73845fcc46 add yi-vl 6b model 2024-05-15 20:02:41 +08:00
hiyouga 51d61fcc89 fix yi vl vllm infer 2024-05-15 19:25:48 +08:00
hiyouga e1f4e53915 add NPU docker images 2024-05-15 19:20:11 +08:00
hoshi-hiyouga 75f405ec30
Merge pull request #3748 from BUAADreamer/main
Add MLLM YI-VL and save processor config during training
2024-05-15 16:40:54 +08:00
hoshi-hiyouga cbeef2aaea
Update visual.py 2024-05-15 16:39:57 +08:00
hiyouga 008e3b3b10 fix fsdp model loading 2024-05-15 16:32:28 +08:00