Commit Graph

886 Commits

Author SHA1 Message Date
hoshi-hiyouga 8a1b389086
Merge pull request #2474 from younesbelkada/add-hf-tags
FEAT: add HF tags for models that have been trained with llama-factory
2024-02-14 10:26:03 +08:00
younesbelkada 0ca0f08162 add v1 hf tags 2024-02-13 05:58:49 +00:00
hiyouga 12b2066e34 fix #2471 2024-02-12 21:07:46 +08:00
hiyouga 91d09a01ac add option to disable version check 2024-02-10 22:31:23 +08:00
hiyouga a754f6e9ec update data/readme 2024-02-10 21:04:29 +08:00
hiyouga a5fb2806cd update default template 2024-02-10 16:44:47 +08:00
hiyouga 7d2dc83c5e improve aligner 2024-02-10 16:39:19 +08:00
hoshi-hiyouga 388b705a8d
Merge pull request #2462 from mnmueller/main
Enable Parsing of SlimOrca
2024-02-09 22:55:48 +08:00
hiyouga 54ea9684ed improve fix tokenizer 2024-02-09 14:53:14 +08:00
Mark Mueller 1d3598afa1 Slim Orca data parsing 2024-02-08 19:32:20 +01:00
Mark Mueller 6703d0546d Slim Orca data parsing 2024-02-08 17:56:18 +01:00
Mark Mueller 7f792dfede Slim Orca data parsing 2024-02-08 17:54:18 +01:00
Mark Mueller 8bd4182609 Slim Orca data parsing 2024-02-08 17:52:36 +01:00
Mark Mueller 36d7a75966 SlimOrca aligner 2024-02-08 08:28:32 -08:00
hoshi-hiyouga d0daaa01f9
Merge pull request #2423 from mayflower/main
Support for german sft and dpo
2024-02-07 15:58:20 +08:00
Johann-Peter Hartmann 49c69ea4b9 WS fix 2024-02-06 20:13:04 +01:00
Johann-Peter Hartmann 1126563505 add ranking to dpo dataset 2024-02-06 20:12:36 +01:00
hiyouga d6775c6522 Update tests.yml 2024-02-07 01:18:22 +08:00
hiyouga 88a1bc9773 lint 2024-02-07 01:10:04 +08:00
hiyouga aacc823b0f Update pyproject.toml 2024-02-07 00:45:58 +08:00
hiyouga 0ae9a16b9d update gc kwargs 2024-02-07 00:38:24 +08:00
hiyouga ebf31b62eb fix #2438 2024-02-06 15:23:08 +08:00
hiyouga 85622ae757 add models 2024-02-06 14:57:23 +08:00
hiyouga ccabb5b04a support qwen1.5 2024-02-06 00:10:51 +08:00
hoshi-hiyouga 7f48c599eb
fix #2436
Update test_toolcall.py
2024-02-05 22:55:28 +08:00
hoshi-hiyouga b5007afb19
Update test_toolcall.py 2024-02-05 22:51:03 +08:00
hoshi-hiyouga d4994235f0
Update test_toolcall.py 2024-02-05 22:50:43 +08:00
tao.jun 4081c88723
Update test_toolcall.py
Add openai version notes
2024-02-05 20:49:23 +08:00
Johann-Peter Hartmann 1ecea9de63
Merge branch 'hiyouga:main' into main 2024-02-04 13:55:00 +00:00
hiyouga 3dc86c4af9 fix #2421 2024-02-04 21:02:55 +08:00
Johann-Peter Hartmann 63da6294dd
Merge branch 'hiyouga:main' into main 2024-02-04 12:51:25 +00:00
hiyouga db0ab4d601 fix reserved label len 2024-02-04 17:54:26 +08:00
hiyouga 19d33ede13 fix #2420 2024-02-04 15:51:47 +08:00
hiyouga b988ce0a0c fix #2189 2024-02-04 00:47:37 +08:00
hiyouga 38e63bfd28 bump up transformers version 2024-02-04 00:01:16 +08:00
hiyouga 51df865734 fix #2397 2024-02-03 23:45:31 +08:00
hiyouga 6545c02790 add hint for freeze #2412 2024-02-03 23:38:56 +08:00
hiyouga 4ecadc3512 fix #2376 2024-02-03 23:14:31 +08:00
hiyouga 901faa16cc support minicpm #2404 2024-02-03 22:36:46 +08:00
Johann-Peter Hartmann b0ffde6e98 add simple german chatml template chatml_de 2024-02-03 09:01:15 +01:00
Johann-Peter Hartmann 870182c3a9 remove comma 2024-02-03 08:48:39 +01:00
Johann-Peter Hartmann 5318cc650e
Merge branch 'hiyouga:main' into main 2024-02-03 08:43:12 +01:00
hoshi-hiyouga 2eaaa9522f
Merge pull request #2411 from lxsyz/main
fix eos_token_id=0 bug
2024-02-02 17:38:16 +08:00
Fallen Angel 3399c0d645
fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token
2024-02-02 17:34:48 +08:00
Johann-Peter Hartmann a5d559a89e
Merge branch 'hiyouga:main' into main 2024-02-01 07:13:31 +01:00
hiyouga ec70eb5d8d Update wechat.jpg 2024-02-01 11:01:12 +08:00
Johann-Peter Hartmann 4e27950acb
Merge branch 'hiyouga:main' into main 2024-01-31 14:05:52 +01:00
hiyouga 39bd5bd524 fix #2388 2024-01-31 17:23:56 +08:00
hiyouga 521ad76552 fix autoset attn impl, update data readme 2024-01-31 11:58:07 +08:00
Johann-Peter Hartmann d9a8301ed4 Add support for german datasets 2024-01-30 10:18:01 +01:00