Rate This Document
Findability
Accuracy
Completeness
Readability

Software Requirements

Item

Supported Version

Management Node

Compute/Storage Node

Description

OS

OmniOperator is compatible with CentOS 7.6, openEuler 20.03 LTS SP1, and openEuler 22.03 LTS.

-

JDK

BiSheng JDK 1.8 (BiSheng JDK 1.8.0_262 recommended)

openEuler 22.03 LTS is incompatible with BiSheng JDK 1.8.0_262, which needs to be replaced with BiSheng JDK 1.8.0_342.

Hadoop

Hadoop 3.2.0

See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).

Hive

Hive 3.1.0

-

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

Spark

Spark 3.1.1

See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).

LLVM

LLVM 12.0.1

-

jemalloc

jemalloc 5.2.1

-

HMPP

HMPP 1.7.0

This library depends on the Kunpeng 920 hardware environment.

Python

Python 3.9.2 or later

-

OpenSSL

OpenSSL.zip

If the OS is openEuler 20.03, it does not need to be deployed.

zstd

zstd 1.4.5

If the OS is openEuler 20.03, manual compilation and installation are not required.

ORC

ORC 1.7.4

-

Protobuf

Protobuf 3.15.0

-

  • If the preceding third-party software has vulnerabilities, fix the vulnerabilities based on official instructions.
  • You can install the big data engine Spark as required.
  • HDFS is used for storage. You are advised to install Kerberos on the management node to ensure cluster security.

Obtaining Software

Table 1 lists the software packages required for OmniOperator and how to obtain them.

Table 1 Software required for OmniOperator

Item

Package Name

Release Type

Download URL

Description

OmniOperator binary package

BoostKit-omniop_1.1.0.zip

Closed source

Contact Huawei technical support.

Binary file of the OmniOperator computing base

SparkExtension

boostkit-omniop-spark-3.1.1-1.1.0-aarch64.zip

Open source

Link

Spark extension package for the OmniOperator computing base.

Verifying Software Package Integrity

After downloading the closed-source binary packages, verify the software packages to ensure that they are consistent with the original software packages on the corresponding websites.

Verify the software package packages as follows:

  1. Obtain the digital certificate and software.
  2. Obtain the verification tool and method from the following link:
  3. Verify the package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.