Rate This Document
Findability
Accuracy
Completeness
Readability

Environment Requirements

Before installing OmniStream, prepare the hardware and software environments to facilitate subsequent installation operations.

Hardware Requirements

Table 1 lists the hardware requirements.

Table 1 Hardware requirements

Item

Node

Processor

New Kunpeng 920 processor model

Memory size

384 GB (12 x 32 GB)

Memory frequency

2666MHz

Network

  • Service network: 10GE
  • Management network: 1GE

Drive

  • System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD)
  • Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)

RAID controller card

LSI SAS3508

OS and Software Requirements

Table 2 lists the OS and software requirements.

Table 2 OS and software requirements

Item

Version

Description

OS

openEuler 22.03 LTS SP4

None

JDK

BiSheng JDK 1.8 (BiSheng JDK 1.8.0_342 recommended)

Deploy the JDK in all containers.

Flink

See Flink Deployment Guide (CentOS & openEuler). Deploy Flink in all containers.

Docker

19.03.15

None

Nexmark

v0.2.0

Perform compilation by following the official instructions. Deploy Nexmark in all containers.

Python

3.9.9

Deploy Python on the container or physical machine from which the job is submitted.

yaml-cpp

0.6.3

Deploy it on the container or physical machine from which the job is submitted.

GCC

10.3.1

None

Maven

3.8.7

Use it to generate the JAR package of UDF test cases.

Obtaining the Software Packages

Table 3 describes the OmniStream software packages and how to obtain them.

Table 3 OmniStream software packages

Software Name

Package Name

Release Type

Description

How to Obtain

OmniStream package

BoostKit-omniruntime-omnistream-1.1.0.zip

Open source

OmniStream software installation package.

Link

UDF translator

UNT-1.0-35.noarch.rpm

Open source

UDF translator RPM package. After the installation is complete, the UDF translator is added to the /opt directory.

Link

AI4C

AI4C-1.0.4-8.aarch64.rpm

Open source

A framework that allows the compiler to integrate machine learning–driven optimization technologies. Install the RPM package.

Link

KACC_JSON

BoostKit-kaccjson_1.1.0.zip

Closed source

Self-developed C++ implementation package used to replace GSON in UDF translation. This ZIP package contains the adaptation layer and KACC_JSON implementation, and also contains header files and a static library. Obtain the Dependency_library_OmniStream.zip file and decompress it.

Link

KSL

BoostKit-ksl_2.5.1.zip

Closed source

Regular expression acceleration library, which contains the ReplaceAll function for optimizing the basic string library and contains header files and a static library.

Contact Huawei technical support.

Dependency_library

Dependency_library.zip

Dependency_library.z01

Open source

Library file on which OmniStream depends. The file is compressed into several volumes. Download all the volumes.

Link 1

Link 2

Verifying the Software Package Integrity

After downloading a software package from the Kunpeng community, verify the software package to ensure that it is consistent with the original one on the website.

Verify a software package as follows:

  1. Obtain the digital certificate and software.
  2. Obtain the verification tool and guide.
  3. Verify the package integrity by following the procedure described in the OpenPGP Signature Verification Guide obtained from the URL.