Commit Graph

2158 Commits

Author SHA1 Message Date
wql a200b7628f chore: set deepspeed version 2024-10-23 20:38:27 +08:00
wql 0365da13d2 chore: move code 2024-10-23 20:35:24 +08:00
wql bab7110cf2 chore: update good to use tokenization_9g.py 2024-10-23 16:16:50 +08:00
wql e6e5cd97e1 chore: change lr to original 2024-10-23 16:06:02 +08:00
wql 0dbc298095 chore: add git ignore 2024-10-23 16:04:49 +08:00
wql 049b3d18be chore: add 9g tokenizer config files 2024-10-23 10:33:04 +08:00
wql 72a0997cdc chore: add 9g-8B file path 2024-10-23 09:49:45 +08:00
wql 3c3bc98f5e feat: add constants for 9g 2024-10-22 17:25:10 +08:00
wql 9ba88b0295 chore: add edited comand for mindie 2024-10-22 17:22:38 +08:00
wql 3f2f80db4d chore: add sort results for mindie 2024-10-22 17:22:07 +08:00
wql 0c6ec554ba Merge branch 'main' of https://osredm.com/p04798526/LLaMA-Factory-310P3 2024-10-15 14:08:56 +08:00
wql d58618f600 add: add mindie test files 2024-10-15 14:05:02 +08:00
wql a8c24c921e Merge branch 'main' of https://osredm.com/p04798526/LLaMA-Factory-310P3 2024-10-12 11:24:07 +08:00
wql b85add402c chore: change models path 2024-10-12 11:24:04 +08:00
wql b00575852e del: del results 2024-10-12 10:57:02 +08:00
wql e72ed9c2ca feat: add sort result 2024-10-12 10:20:03 +08:00
wql cf458a5ea4 chore: change batch run 2024-09-27 09:16:42 +08:00
wql 001a588be1 fix: fix small bug 2024-09-26 17:28:24 +08:00
wql 14a932842f chore: change batch run 2024-09-26 17:00:41 +08:00
wql 54388f10e0 feat: done add num token to inference 2024-09-26 16:48:17 +08:00
wql cf1853978a feat: update num token 2024-09-26 16:21:33 +08:00
wql 1f3703ae96 chore: add print 2024-09-26 15:02:21 +08:00
wql 1ac91733e4 feat: add include_num_input_tokens_seen 2024-09-26 14:46:39 +08:00
wql 0071124994 chore: add print 2024-09-26 14:27:01 +08:00
wql a4633cc12f test: retry 2024-09-26 14:09:27 +08:00
wql 9f90554353 fix: reverse last commit 2024-09-26 14:05:10 +08:00
wql 9905787eeb chore: add print 2024-09-26 14:00:14 +08:00
wql cc8d2e7ea0 chore: change lr 2024-09-26 11:10:31 +08:00
wql 0b496d2211 chore: set batch run 2024-09-25 10:28:34 +08:00
wql fb6777c81f fix: fix typo 2024-09-25 10:25:47 +08:00
wql 379f6d1c47 fix: fix model name 2024-09-25 10:21:25 +08:00
wql 78b6f5b60c chore: add echo 2024-09-25 09:57:05 +08:00
wql 87c1a70566 chore: change batch run 2024-09-24 10:16:19 +08:00
wql 6d6f1cbdce chore: modify tee 2024-09-24 09:41:24 +08:00
wql 87b6708a8b feat: add fail mark for fail process 2024-09-24 09:32:12 +08:00
wql 4d27d046a0 chore: change lr 2024-09-19 17:08:17 +08:00
wql 8437e41f21 chore: prepare batch run 2024-09-19 16:58:50 +08:00
wql bb89b90b1a chore: reverse test 2024-09-19 16:57:15 +08:00
wql accd7c6f98 test: test moxing 2024-09-19 16:54:59 +08:00
wql 735b989587 chore: change lr 2024-09-19 16:05:33 +08:00
wql 618e57fa6b fix: fix bug 2024-09-19 15:33:20 +08:00
wql 7d0cf5a79c chore: add echo 2024-09-19 15:30:31 +08:00
wql 647525952d chore: set ASCEND_RT_VISIBLE_DEVICES 2024-09-19 15:25:12 +08:00
wql 5a306611bc train: qwen 2024-09-19 15:11:35 +08:00
wql e99fab5e4c chore: modify batch run 2024-09-19 14:03:17 +08:00
wql 53f79118f0 chore: change output dir 2024-09-19 13:54:43 +08:00
wql b83275d5c6 chore: change models path 2024-09-19 13:52:25 +08:00
wql bbbe4e2d00 testrun: test inference 2024-09-19 13:30:51 +08:00
wql 935319d630 chore: add needed packages 2024-09-19 11:07:15 +08:00
wql fa94e3af4b test: remove echo 2024-09-18 17:31:11 +08:00