整体流程示例
简要示范全流程使用自动调优,从获取模板到结果应用(以下步骤以PostgreSQL为例)。
- 获取模板文件。
根据需要运行的应用选择配置模板文件。
1
devkit kat template -g -o /opt/template
命令中参数“-g”将进入交互界面配置模板文件需要的基本参数,参数“-o /opt/template”表示生成的模板文件存放目录。
- (可选)转换简易模板文件。
当简易模板无法满足用户对应用的参数调整时可转换为通用参数模板文件进行操作:
1
devkit kat template -c /opt/template/template_xxxx/task_xxxx_xxx.json
返回信息:
1
[2024-12-19 13:53:27 UTC] [KAT] [ info ] - /opt/template/template_xxxx/task_Postgresql.json has been converted to /opt/template/template_xxxx/task_Postgresql_custom.json
图1 通用模板文件 - 配置模板文件中的必须参数。
根据实际情况补充模板文件中的未填写参数。
图2 配置简易模板参数 - 开启自动调优。
使用已完善的简易模板文件开始自动调优。
1
devkit kat train -t /opt/template/template_xxxx/task_Postgresql.json -p /opt/template/template_xxxx/param_Postgresql.json
任务参数已在task_Postgresql.json中配置,应用参数在param_Postgresql.json中配置。
返回信息如下:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52
[2024-12-31 08:15:58 UTC] [KAT] [message] - Create work space /opt/template/template_xxxx/train-20241231-161557 [2024-12-31 08:16:09 UTC] [KAT] [message] - Application : Postgresql [2024-12-31 08:16:09 UTC] [KAT] [message] - Tuning Direction : high [2024-12-31 08:16:09 UTC] [KAT] [message] - ================================================================================ [2024-12-31 08:16:09 UTC] [KAT] [message] - Kunpeng Auto Tuner - task set up [2024-12-31 08:16:09 UTC] [KAT] [message] - start time: 2024-12-31 08:16:09 [2024-12-31 08:16:09 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:16:18 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <params prepare> start ----------------- [2024-12-31 08:17:24 UTC] [KAT] [message] - ================================================================================ [2024-12-31 08:17:24 UTC] [KAT] [message] - Kunpeng Auto Tuner - base line test [2024-12-31 08:17:24 UTC] [KAT] [message] - start time: 2024-12-31 08:17:24 [2024-12-31 08:17:24 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:17:24 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <round set up> start ----------------- [2024-12-31 08:17:24 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <run test> start ----------------- [2024-12-31 08:18:21 UTC] [KAT] [message] - ### Run test successfully. Performance of this round is [141.87] ### [2024-12-31 08:18:21 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <round tear down> start ----------------- [2024-12-31 08:18:25 UTC] [KAT] [message] - ================================================================================ [2024-12-31 08:18:25 UTC] [KAT] [message] - Kunpeng Auto Tuner - round 1 [2024-12-31 08:18:25 UTC] [KAT] [message] - start time: 2024-12-31 08:18:25 [2024-12-31 08:18:25 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:18:25 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <round set up> start ----------------- [2024-12-31 08:18:25 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <assign params> start ----------------- [2024-12-31 08:18:57 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <run test> start ----------------- [2024-12-31 08:19:17 UTC] [KAT] [message] - ### Run test successfully. Performance of this round is [159.93] ### [2024-12-31 08:19:17 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <round tear down> start ----------------- ... ... ... [2024-12-31 08:24:20 UTC] [KAT] [message] - ============================== Auto Tuning Report ============================== [2024-12-31 08:24:20 UTC] [KAT] [message] - Total round : 5 [2024-12-31 08:24:20 UTC] [KAT] [message] - Total run : 6 [2024-12-31 08:24:20 UTC] [KAT] [message] - Fail times : 0 [2024-12-31 08:24:20 UTC] [KAT] [message] - Application : Postgresql [2024-12-31 08:24:20 UTC] [KAT] [message] - Tuning Direction : high [2024-12-31 08:24:20 UTC] [KAT] [message] - Performance description: tpmC, transactions per minute [2024-12-31 08:24:20 UTC] [KAT] [message] - Baseline performance : 141.87 [2024-12-31 08:24:20 UTC] [KAT] [message] - Top 10 performance: [2024-12-31 08:24:20 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:24:20 UTC] [KAT] [message] - | Rank | Round | Performance | Improvement (%) | [2024-12-31 08:24:20 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:24:20 UTC] [KAT] [message] - | 1 | round 5 | 174.94 | 23.31 | [2024-12-31 08:24:20 UTC] [KAT] [message] - | 2 | round 1 | 159.93 | 12.73 | [2024-12-31 08:24:20 UTC] [KAT] [message] - | 3 | round 3 | 155.5 | 9.61 | [2024-12-31 08:24:20 UTC] [KAT] [message] - | 4 | round 4 | 141.94 | 0.05 | [2024-12-31 08:24:20 UTC] [KAT] [message] - | 5 | round 2 | 114.16 | -19.53 | [2024-12-31 08:24:20 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 08:24:20 UTC] [KAT] [message] - Note: [2024-12-31 08:24:20 UTC] [KAT] [message] - The performance value is the return value of the run test step, [2024-12-31 08:24:20 UTC] [KAT] [message] - Performance improvement (%) = [2024-12-31 08:24:20 UTC] [KAT] [message] - (round performance - baseline performance) / baseline performance * 100 [2024-12-31 08:24:20 UTC] [KAT] [message] - Case package locate: /opt/template/template_xxxx/train-20241231-161557 [2024-12-31 08:24:20 UTC] [KAT] [message] - ================================================================================
- 查看调优结果。
自动调优后的参数集生成在/opt/template/template_xxxx/train-20241231-161557目录下,可根据调优结果选择参数集进行应用参数的调整。
1
ls /opt/template/template_xxxx/train-20241231-161557
返回信息如下:
1
param_cfg.json task_cfg.json train.db
- 运用调优结果。
1
devkit kat use -i /opt/template/template_xxxx/train-20241231-161557
进入交互界面。
- 查看性能测试数据。
键入“show 1”,按下“Enter”,查看自动调优第一轮详细任务参数和性能数据。
图3 展示第一轮任务详情键入“top 3”,按下“Enter”,查看性能前二的数据。
图4 展示数据 - (可选)对数据进行复测。
键入“test r1”,按下“Enter”,对第一轮任务进行复测。
图5 复测 - (可选)将指定轮次参数设置到应用和系统中。
键入“set 1”,按下“Enter”,将自动调优后第一轮任务的参数设置到应用和系统中。
图6 赋值成功 - (可选)重置应用和系统参数到赋值前。
键入“reset”,按下“Enter”,对第一轮任务重置为初始任务参数。
返回信息:
1
[2024-12-31 03:53:23 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <params recover> start -----------------
- 退出应用界面。
键入“exit”,按下“Enter”键。
返回信息:
1 2 3 4 5 6 7 8
[2024-12-31 13:50:40 UTC] [KAT] [message] - Finish using /opt/template/template_xxxx/train-20241231-161557, goodbye! [2024-12-31 13:50:40 UTC] [KAT] [message] - ================================================================================ [2024-12-31 13:50:40 UTC] [KAT] [message] - Kunpeng Auto Tuner - task tear down [2024-12-31 13:50:40 UTC] [KAT] [message] - start time: 2024-12-31 16:25:40 [2024-12-31 13:50:40 UTC] [KAT] [message] - -------------------------------------------------------------------------------- [2024-12-31 13:50:40 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <params recover> start ----------------- [2024-12-31 13:50:41 UTC] [KAT] [message] - --------- Kunpeng Auto Tuner - Step <tear down> start ----------------- [2024-12-31 13:50:43 UTC] [KAT] [message] - ================================================================================
父主题: 自动调优