我要评分
获取效率
正确性
完整性
易理解

Software Requirements

Item

Supported Version

Management Node

Compute/Storage Node

Description

OS

OmniOperator is compatible with CentOS 7.6, openEuler 20.03 LTS SP1, and openEuler 22.03 LTS.

√

√

-

JDK

BiSheng JDK 1.8 (BiSheng JDK 1.8.0_262 recommended)

√

√

openEuler 22.03 LTS is incompatible with BiSheng JDK 1.8.0_262, which needs to be replaced with BiSheng JDK 1.8.0_342.

Hadoop

Hadoop 3.2.0

√

√

See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).

Hive

Hive 3.1.0

√

-

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

Spark

Spark 3.1.1

√

√

See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).

LLVM

LLVM 12.0.1

√

√

-

jemalloc

jemalloc 5.2.1

√

√

-

HMPP

HMPP 1.7.0

√

√

This library depends on the Kunpeng 920 hardware environment.

Python

Python 3.9.2 or later

√

√

-

OpenSSL

OpenSSL.zip

√

√

If the OS is openEuler 20.03, it does not need to be deployed.

zstd

zstd 1.4.5

√

√

If the OS is openEuler 20.03, manual compilation and installation are not required.

ORC

ORC 1.7.4

√

√

-

Protobuf

Protobuf 3.15.0

√

√

-

  • If the preceding third-party software has vulnerabilities, fix the vulnerabilities based on official instructions.
  • You can install the big data engine Spark as required.
  • HDFS is used for storage. You are advised to install Kerberos on the management node to ensure cluster security.

Obtaining Software

Table 1 lists the software packages required for OmniOperator and how to obtain them.

Table 1 Software required for OmniOperator

Item

Package Name

Release Type

Download URL

Description

OmniOperator binary package

BoostKit-omniop_1.1.0.zip

Closed source

Contact Huawei technical support.

Binary file of the OmniOperator computing base

SparkExtension

boostkit-omniop-spark-3.1.1-1.1.0-aarch64.zip

Open source

Link

Spark extension package for the OmniOperator computing base.

Verifying Software Package Integrity

After downloading the closed-source binary packages, verify the software packages to ensure that they are consistent with the original software packages on the corresponding websites.

Verify the software package packages as follows:

  1. Obtain the digital certificate and software.
  2. Obtain the verification tool and method from the following link:
  3. Verify the package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.