我要评分
获取效率
正确性
完整性
易理解

Environment Requirements

Before installing OmniAdvisor, prepare the hardware and software environments to facilitate subsequent installation operations.

Hardware Requirements

Table 1 lists the hardware requirements for each node in the cluster.

Table 1 Hardware requirements

Item

Management/Compute/Storage Node

Processor

Kunpeng 920 5250

Memory size

384 GB (12 x 32 GB)

Memory frequency

2666 MHz

NIC

  • Service network: 10GE
  • Management network: GE

Drive

  • System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD)
  • Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)

RAID controller card

LSI SAS3508

OS and Software Requirements

Table 2 lists the OS and software requirements for each node in the cluster.

Table 2 OS and software requirements

Item

Version

Description

Management Node (Server)

Compute/Storage Node

OS

  • CentOS 7.9
  • openEuler 22.03 LTS SP1

Install the correct version.

JDK

BiSheng JDK 1.8.0_342

Download URL: BiSheng JDK 1.8.0_342.

For details about how to install the BiSheng JDK, see BiSheng JDK 8 Installation Guide.

Hadoop

3.2.0

See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).

Hive

3.1.0

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

Spark

3.1.1/3.3.1

See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

ZooKeeper

3.6.2 or later

See ZooKeeper Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

Tez

0.10.0

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

Python

3.10.2 or later

Install a correct version.

MySQL

Kernel 15.1 or later (Run mysql --version to check the kernel version.)

See the MariaDB installation description in Hive Deployment Guide (CentOS 7.6 & openEuler 20.03) .

-

Anaconda

4.12.0 or later

Python package management tool. Determine whether to install Anaconda based on your requirements.

-

  • √: indicates that the item is required on the node.
  • -: indicates that the item is not required on the node.
  • If the preceding third-party software has vulnerabilities, fix the vulnerabilities based on official instructions.
  • The preceding component versions may be different from those in the Deployment Guide. The Deployment Guide is for reference only.

Obtaining Software

Table 3 describes the OmniAdvisor software packages and how to obtain them.

Table 3 OmniAdvisor software packages

Item

Package Name

Release Type

Description

Download URL

OmniRuntime package

BoostKit-omniruntime_1.5.0.zip

Closed source

OmniRuntime package. Decompress the package to obtain the OmniAdvisor software package BoostKit-omniadvisor_1.1.0.zip. Performs parameter sampling and recommendation and other functions.

Contact Huawei technical support.

NOTE:

Before using the software package, read and agree to Kunpeng BoostKit User License Agreement 2.0.

OmniAdvisor log parser JAR package

boostkit-omniadvisor-log-analyzer-1.1.0-aarch64.zip

Open source

Parses logs.

Link

NOTE:

Download the package based on the description in the link and use the commands in the description to assemble the package into boostkit-omniadvisor-log-analyzer-1.1.0-aarch64.zip.

hive-testbench

hive-testbench-hdp3.zip

Open source

TestBench source package used for generating TPC-DS/TPC-H data

Link

Verifying the Software Package Integrity

After downloading a software package from the Kunpeng community, verify the software package to ensure that it is consistent with the original one on the website.

Verify the software packages as follows:

  1. Obtain the digital certificate and software.
  2. Obtain the verification tool and method from the following link:
  3. Verify the package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.