p04798526
/
LLaMA-Factory-310P3
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

test: add test results

This commit is contained in:
wql 2024-11-29 17:42:10 +08:00
parent 774de28057
commit 1dde40142d
3 changed files with 11 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
mindie_test/results/310p_inference_Qwen-7B_1_npu_20241129172809/npu_status_20241129172809.json Normal file
View File

@ -0,0 +1,7 @@
{"cur_time": "2024-11-29 17:28:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:29:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:30:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:31:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:32:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:33:11", "npu_power_dissipation": [], "device_mem_usage": []}
{"cur_time": "2024-11-29 17:34:11", "npu_power_dissipation": [], "device_mem_usage": []}

2
mindie_test/results/310p_inference_Qwen-7B_1_npu_20241129172809/performance_single_pa_batch1_tp1_formatted_result.csv Normal file
View File

@ -0,0 +1,2 @@
Model |Batchsize |In_seq |Out_seq |Total time(s) |First token time(ms) |Non-first token time(ms) |Non-first token Throughout(Tokens/s)|E2E Throughout(Tokens/s) |Non-first token Throughout Average(Tokens/s) |E2E Throughout Average(Tokens/s)
qwen_7b |1 |256 |256 |256.1785299778 |985.68 |1000.33 |0.9996701089 |0.9993031033 |0.9996701089 |0.9993031033
1 Model Batchsize In_seq Out_seq Total time(s) First token time(ms) Non-first token time(ms) Non-first token Throughout(Tokens/s) E2E Throughout(Tokens/s) Non-first token Throughout Average(Tokens/s) E2E Throughout Average(Tokens/s)
2 qwen_7b 1 256 256 256.1785299778 985.68 1000.33 0.9996701089 0.9993031033 0.9996701089 0.9993031033

2
mindie_test/results/310p_inference_Qwen-7B_1_npu_20241129172809/performance_single_pa_batch1_tp1_result.csv Normal file
View File

@ -0,0 +1,2 @@
Model,Batchsize,In_seq,Out_seq,Total time(s),First token time(ms),Non-first token time(ms),Non-first token Throughout(Tokens/s),Throughout(Tokens/s),Non-first token Throughout Average(Tokens/s),E2E Throughout Average(Tokens/s)
qwen_7b ,1 ,256 ,256 ,256.1785299778 ,985.68 ,1000.33 ,0.9996701089 ,0.9993031033 ,0.9996701089 ,0.9993031033
1 Model Batchsize In_seq Out_seq Total time(s) First token time(ms) Non-first token time(ms) Non-first token Throughout(Tokens/s) Throughout(Tokens/s) Non-first token Throughout Average(Tokens/s) E2E Throughout Average(Tokens/s)
2 qwen_7b 1 256 256 256.1785299778 985.68 1000.33 0.9996701089 0.9993031033 0.9996701089 0.9993031033