test命令

命令功能

使用指定轮次的参数再次进行测试。

命令格式

test <n1,n2,...> <n> test round n1,n2,... and test <n> times

使用示例

对第一轮复测两次。

test 1 2

返回信息如下：

[2025-05-19 07:21:42 UTC] [KAT] [message] - ================================================================================
[2025-05-19 07:21:42 UTC] [KAT] [message] -           Kunpeng Auto Tuner - test 1
[2025-05-19 07:21:42 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step    <round set up>    start -----------
[2025-05-19 07:21:42 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step   <assign params>    start -----------
[2025-05-19 07:22:03 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step      <run test>      start -----------
[2025-05-19 07:22:14 UTC] [KAT] [message] - --------- Run test successfully.
[2025-05-19 07:22:14 UTC] [KAT] [message] - --------- Performance     :       61.58
[2025-05-19 07:22:14 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step  <round tear down>   start -----------
[2025-05-19 07:22:16 UTC] [KAT] [message] - ================================================================================
[2025-05-19 07:22:16 UTC] [KAT] [message] -           Kunpeng Auto Tuner - test 2
[2025-05-19 07:22:16 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step    <round set up>    start -----------
[2025-05-19 07:22:16 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step   <assign params>    start -----------
[2025-05-19 07:22:37 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step      <run test>      start -----------
[2025-05-19 07:22:50 UTC] [KAT] [message] - --------- Run test successfully.
[2025-05-19 07:22:50 UTC] [KAT] [message] - --------- Performance     :        56.2
[2025-05-19 07:22:50 UTC] [KAT] [message] - --------- kunpeng automatic tuning - Step  <round tear down>   start -----------
[2025-05-19 07:22:52 UTC] [KAT] [message] - ================================ Detail Report =================================
[2025-05-19 07:22:52 UTC] [KAT] [message] - Actual test times : 2
[2025-05-19 07:22:52 UTC] [KAT] [message] - Fail times        : 0
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - |  No.  |  Round  | Status | Performance | Performance(before) |
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - |   1   |    1    |   S    |    61.58    |       103.32        |
[2025-05-19 07:22:52 UTC] [KAT] [message] - |   2   |    1    |   S    |    56.2     |       103.32        |
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - ================================  Total Report =================================
[2025-05-19 07:22:52 UTC] [KAT] [message] - Tested rounds     : 1
[2025-05-19 07:22:52 UTC] [KAT] [message] - Tuning Direction : high
[2025-05-19 07:22:52 UTC] [KAT] [message] - Performance description: tpmC, transactions per minute
[2025-05-19 07:22:52 UTC] [KAT] [message] - Baseline performance  : 38.01
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - |  Round  | Times | Performance | Performance(before) | Change (%) |  CV(%) |
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - |    1    |   2   |    58.89    |       103.32        |   -43.00   |  4.57  |
[2025-05-19 07:22:52 UTC] [KAT] [message] - --------------------------------------------------------------------------------
[2025-05-19 07:22:52 UTC] [KAT] [message] - WARNING:
[2025-05-19 07:22:52 UTC] [KAT] [message] -     The "Change (%)" in red indicates the result of that round changes
[2025-05-19 07:22:52 UTC] [KAT] [message] - greatly compared with the previous training result. Check that the test
[2025-05-19 07:22:52 UTC] [KAT] [message] - environment is stable.
[2025-05-19 07:22:52 UTC] [KAT] [message] - ================================================================================

在使用参数赋值前，为确定调优参数是否稳定，可对性能提升较好的轮次进行多次复测，结果中变异系数“CV(%)”越小，则表明复测的性能数据一致性越高，对应轮次的调优参数越稳定。

合理的测试场景下，变异系数“CV(%)”低于1%认为参数对应优化的效果非常稳定，1%-5%是比较稳定，5%-10%不太稳定可根据实际情况是否接受，若超过10%则认为此轮的参数不稳定，建议优先解决性能数据的稳定性问题（环境或人为因素）。