Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

Environment Requirements for OmniMV

Hardware Requirements

Table 1 lists the hardware requirements for each node in the cluster.

Table 1 Hardware requirements

Item

Management Node

Compute/Storage Node

Processor

Kunpeng 920 5220

Kunpeng 920 5220

Memory size

384 GB (12 x 32 GB)

384 GB (12 x 32 GB)

Memory frequency

2666 MHz

2666 MHz

NIC
  • Service network: 10GE
  • Management network: GE
  • Service network: 10GE
  • Management network: GE

Drive
  • System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD)
  • Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)
  • System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD)
  • Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)

RAID controller card

LSI SAS3508

LSI SAS3508

OS and Software Requirements

Table 2 lists the OS and software requirements for each node in the cluster.

Table 2 OS and software requirements

Item

Version

Description

Management Node

(Server)

Compute/Storage Node

OS

openEuler 22.03 LTS

-

√

√

JDK

BiSheng JDK 1.8 (BiSheng JDK 1.8.0_342 recommended)

openEuler 22.03 LTS is incompatible with BiSheng JDK 1.8.0_262, which needs to be replaced with BiSheng JDK 1.8.0_342.

√

√

Hadoop

3.2.0

See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).

√

√

Hive

3.1.0

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

√

-

Spark

3.1.1

See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).

√

√

ZooKeeper

3.6.2 or later

See ZooKeeper Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

√

ClickHouse

22.3.6.5

-

√

√

Python

3.10.2 or later

-

√

√

Obtaining Software

Table 3 lists the software packages required for OmniMV and how to obtain them.

Table 3 Software required for OmniMV

Software Name

Package Name

Release Type

Description

Download URL

OmniRuntime package

BoostKit-omniruntime_1.0.0.zip

Closed source

Decompress the OmniRuntime package to obtain the OmniOperator binary package and OmniMV binary package.

Contact Huawei technical support.

JAR package of the OmniMV plugin

boostkit-omnimv-spark-3.1.1-1.1.0-aarch64.jar

Open source

Spark extension package for using the OmniMV feature.

Link

JAR package for parsing OmniMV logs

boostkit-omnimv-logparser-spark-3.1.1-1.1.0-aarch64.jar

Open source

Function package for OmniMV to parse Spark logs.

Link

hive-testbench

hive-testbench-hdp3.zip

Open source

TestBench source package used for generating TPC-DS/TPC-H data.

Link

Verifying Software Package Integrity

After downloading a software package from the Kunpeng community, verify the software package to ensure that it is consistent with the original one on the website.

Verify a software package as follows:

  1. Obtain the digital certificate and software.
  2. Obtain the verification tool and method from the following link:
  3. Verify the package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.
Parent topic: Environment Requirements