Environment Requirements

Before installing OmniShuffle, prepare the hardware and software environments to facilitate subsequent installation operations.

Hardware requirements

See Table 1 and Table 2 for the hardware requirements for each node in the cluster.

**Table 1** ESS hardware versions
Item	Management/Compute/Storage Node
Processor	Kunpeng 920 5250
Memory size	384 GB (12 x 32 GB)
Memory frequency	2666 MHz
NIC	Service network: 10GE Management network: GE
Drive	System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD) Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)
RAID controller card	LSI SAS3508

**Table 2** RSS hardware versions
Item	Management Node	Compute Node	Storage Node
Processor	Kunpeng 920 7260	Kunpeng 920 7260	Kunpeng 920 7260
Memory size	512 GB	512 GB	512 GB
Memory frequency	2666 MHz	2666 MHz	2666 MHz
NIC	Service network: 10GE Management network: GE	Service network: 20GE Management network: GE	Service network: 20GE Management network: GE
Drive	System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD) Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)	System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD) Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)	System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD) Data drive: 2 x 4 TB NVMe SSD
RAID controller card	LSI SAS3508	LSI SAS3508	LSI SAS3508

Software Requirements

Table 3 lists the software requirements for each node in the cluster.

**Table 3** Software versions
Software Name	Software Version	Description	Management Node	Compute/Storage Node
OS	openEuler 22.03 LTS SP1 openEuler 20.03 LTS SP1	-	√	√
NIC driver	Mellanox 5.4-3.6.8.1-LTS	-	√	√
JDK	BiSheng JDK 1.8 (BiSheng JDK 1.8.0_342 recommended)	openEuler 22.03 LTS SP1 is incompatible with BiSheng JDK 1.8.0_262, which needs to be replaced with BiSheng JDK 1.8.0_342. For details about how to install the BiSheng JDK, see BiSheng JDK 8 Installation Guide.	√	√
Hadoop	3.2.0	See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).	√	√
Hive	3.1.0	See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).	√	-
Spark	3.1.1 3.3.1	See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).	√	-
ZooKeeper	3.6.2 or later	See ZooKeeper Deployment Guide (CentOS 7.6 & openEuler 20.03).	√	-
√: indicates that the item is required on the node. -: indicates that the item is not required on the node.

If the system software does not contain KRB5, install KRB5 in secure mode.

Obtaining the Software Package

**Table 4** OmniShuffle software package
Software Name	Package Name	Release Type	Description	Download URL
OmniShuffle	BoostKit-omnishuffle_1.9.0.tar.gz	Closed source	OmniShuffle software package	Kunpeng community NOTE: Before using the software package, read and agree to the user agreement.

Verifying Software Package Integrity

To prevent a software package from being maliciously tampered with during transfer or storage, download also the corresponding digital signature file for integrity verification while obtaining the software package.

Obtain the software package based on Table 4.
Obtain the OpenPGP Signature Verification Guide.
- For carriers: https://support.huawei.com/carrier/digitalSignatureAction.
- For enterprises: https://support.huawei.com/enterprise/en/tool/pgp-verify-TL1000000054.
Verify the software package integrity by following instructions in OpenPGP Signature Verification Guide.
- If the verification fails, do not use the software package, and contact Huawei technical support.
- Before using the software package for an installation or upgrade, verify the digital signature to ensure that the software has not been tampered with.

Parent topic: Installation Overview