Rate This Document
Findability
Accuracy
Completeness
Readability

Kunpeng AutoTuner Functions

The Kunpeng AutoTuner is available on the Kunpeng platform. It supports the top 10 big data and database applications. Using built-in AI algorithms, it automatically applies optimal parameter combinations to real-world applications, enabling out-of-the-box optimization for typical workloads.

When Kunpeng 920 series processors are used, Kunpeng register parameters are automatically tuned. The OS kernel version must be 4.19.90-2012.4.0.0053.oe1.aarch64 or 5.10.0-182.0.0.95.oe2203sp3.aarch64.
Figure 1 Kunpeng AutoTuner process
Table 1 Kunpeng AutoTuner application scenarios

Scenario

Application Startup Method

Pressure Test Method

Description

Database

MySQL

Using the configuration file specified by mysqld

Using Sysbench

You can modify the simple tuning template generated by the tool and use it for tuning. For details about each scenario, see 3.

openGauss

Using the database folder specified by gs_ctl

Using BenchmarkSQL

Vastbase

Using the database folder specified by vb_ctl

Using BenchmarkSQL

RocksDB

Using db_bench

Using rocksdb_dbbench

PostgreSQL

Using the data directory specified by pg_ctl

Using BenchmarkSQL

Redis

Using the data directory specified by redis-server

Use the built-in redis-benchmark tool

Big data

Hive

Using the Hive executable file

Using tpcds

Spark

Automatically loading the configuration file

  • on yarn mode: Use yarn-session.sh to submit a task for tuning.
  • standalone mode: Use start-all.sh to start.

Using tpcds

Flink

Automatically loading the configuration file

  • on yarn mode: Use yarn-session.sh to submit a task for tuning.
  • standalone mode: Use start-cluster.sh to start.

Using HiBench

Kafka

Using the configuration file specified by kafka-server-start.sh

Using the built-in kafka-producer-perf-test.sh file

Custom

Custom

-

-

You can modify the custom tuning template generated by the tool and use it for tuning.

NOTE:

The tool provides custom tuning templates. You can modify a template for tuning. For details, see Modifying a Custom Template.

Prerequisites

  • You have installed the Kunpeng AutoTuner. See Installing the Tool.
  • If you have installed the tool using a compressed package, decompress the package and switch to the tool directory. Then run the command in ./ mode, for example, ./devkit kat -h. If you have installed the tool using an RPM package, run devkit kat -h. This section uses an RPM package as an example.

Command Function

Automatically tunes application parameters to improve application performance metrics in different scenarios.

Syntax

1
 devkit kat [-h | --help] TASK [ARGS]
Complete the following settings before starting a task:
  • Task parameters: parameter name, value range, and setting mode.
  • Application scenario: application name, benchmark (if any), and performance metrics. Ensure that the application and performance test tool work properly.

Adjust the task parameters and application scenario based on the actual service scenario and the parameters to be tuned.

Example

Run the following command to view the information about the functions supported by the AutoTuner:

1
devkit kat -h

Command output:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
Usage: devkit kat [-h | --help] TASK [ARGS]

 The most commonly used devkit kat sub tasks are:
   help       Get help information
   train      Run the auto tuner train task
   template   Run the auto tuner template task
   use        Run the auto tuner use task
   man        Run the auto tuner man task

 See 'devkit kat TASK --help' for more information on a specific task.
Table 2 Function description

Function

Description

Remarks

help

Displays help information.

-

train

Enables automatic tuning.

Starts automatic tuning. The Kunpeng AutoTuner automatically tunes task parameters based on service scenario metrics.

template

Generates a template file.

Generates a configuration template of the parameter space and application scenario for the Kunpeng AutoTuner. After a template is generated, you can run the devkit kat train -t task.yaml -p param.yaml command to start automatic tuning.

use

Uses the tuning result.

Uses the report result after automatic tuning. You can also specify the parameter file directory and perform tuning on the use screen.

man

Displays the function manual.

Displays the tool manual, which provides details about the functions and examples of all commands.