Kunpeng AutoTuner Functions
The Kunpeng AutoTuner is available on the Kunpeng platform. It supports the top 10 big data and database applications. Using built-in AI algorithms, it automatically applies optimal parameter combinations to real-world applications, enabling out-of-the-box optimization for typical workloads.
|
Scenario |
Application Startup Method |
Pressure Test Method |
Description |
|
|---|---|---|---|---|
|
Database |
MySQL |
Using the configuration file specified by mysqld |
Using Sysbench |
You can modify the simple tuning template generated by the tool and use it for tuning. For details about each scenario, see 3. |
|
openGauss |
Using the database folder specified by gs_ctl |
Using BenchmarkSQL |
||
|
Vastbase |
Using the database folder specified by vb_ctl |
Using BenchmarkSQL |
||
|
RocksDB |
Using db_bench |
Using rocksdb_dbbench |
||
|
PostgreSQL |
Using the data directory specified by pg_ctl |
Using BenchmarkSQL |
||
|
Redis |
Using the data directory specified by redis-server |
Use the built-in redis-benchmark tool |
||
|
Big data |
Hive |
Using the Hive executable file |
Using tpcds |
|
|
Spark |
Automatically loading the configuration file
|
Using tpcds |
||
|
Flink |
Automatically loading the configuration file
|
Using HiBench |
||
|
Kafka |
Using the configuration file specified by kafka-server-start.sh |
Using the built-in kafka-producer-perf-test.sh file |
||
|
Custom |
Custom |
- |
- |
You can modify the custom tuning template generated by the tool and use it for tuning.
NOTE:
The tool provides custom tuning templates. You can modify a template for tuning. For details, see Modifying a Custom Template. |
Prerequisites
- You have installed the Kunpeng AutoTuner. See Installing the Tool.
- If you have installed the tool using a compressed package, decompress the package and switch to the tool directory. Then run the command in ./ mode, for example, ./devkit kat -h. If you have installed the tool using an RPM package, run devkit kat -h. This section uses an RPM package as an example.
Command Function
Automatically tunes application parameters to improve application performance metrics in different scenarios.
Syntax
1
|
devkit kat [-h | --help] TASK [ARGS] |
- Task parameters: parameter name, value range, and setting mode.
- Application scenario: application name, benchmark (if any), and performance metrics. Ensure that the application and performance test tool work properly.
Adjust the task parameters and application scenario based on the actual service scenario and the parameters to be tuned.
Example
Run the following command to view the information about the functions supported by the AutoTuner:
1
|
devkit kat -h |
Command output:
1 2 3 4 5 6 7 8 9 10 |
Usage: devkit kat [-h | --help] TASK [ARGS] The most commonly used devkit kat sub tasks are: help Get help information train Run the auto tuner train task template Run the auto tuner template task use Run the auto tuner use task man Run the auto tuner man task See 'devkit kat TASK --help' for more information on a specific task. |
|
Function |
Description |
Remarks |
|---|---|---|
|
help |
Displays help information. |
- |
|
train |
Enables automatic tuning. |
Starts automatic tuning. The Kunpeng AutoTuner automatically tunes task parameters based on service scenario metrics. |
|
template |
Generates a template file. |
Generates a configuration template of the parameter space and application scenario for the Kunpeng AutoTuner. After a template is generated, you can run the devkit kat train -t task.yaml -p param.yaml command to start automatic tuning. |
|
use |
Uses the tuning result. |
Uses the report result after automatic tuning. You can also specify the parameter file directory and perform tuning on the use screen. |
|
man |
Displays the function manual. |
Displays the tool manual, which provides details about the functions and examples of all commands. |