Rate This Document
Findability
Accuracy
Completeness
Readability

Environment Requirements

Before installing OmniScheduler, prepare the hardware and software environments to facilitate subsequent installation operations.

Hardware Requirements

Table 1 lists the hardware requirements for each node in the cluster.

Table 1 Hardware requirements

Item

Management/Compute/Storage Node

Processor

Kunpeng 920 5250

Memory size

384 GB (12 x 32 GB)

Memory frequency

2666 MHz

NIC

  • Service network: 10GE
  • Management network: 1GE

Drive

  • System drive: 1 x RAID 0 (1 x 1.2 TB SAS HDD)
  • Data drive: 12 x RAID 0 (12 x 8 TB SATA HDD)

RAID controller card

LSI SAS3508

OS and Software Requirements

Table 2 lists the OS and software requirements for each node in the cluster.

Table 2 OS and software requirements

Item

Version

Description

Management Node

Compute/Storage Node

OS

openEuler 22.03 LTS SP3

-

JDK

BiSheng JDK 1.8.0_342

For details about how to install the BiSheng JDK, see BiSheng JDK 8 Installation Guide.

Hadoop

3.3.4

See Hadoop Deployment Guide (CentOS 7.6 & openEuler 20.03).

Spark

3.1.1/3.3.1

See Spark Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

Hive

3.1.0

See Hive Deployment Guide (CentOS 7.6 & openEuler 20.03).

-

Prometheus

2.45.4

Download it from the official website: Link

-

Grafana

10.4.2

Download it from the official website: Link

-

Node Exporter

1.7.0

Download it from the official website: Link

-

Go

1.22.2

Download it from the official website: Link

Node

19.9.0

Download it from the official website: Link

Python

3.6.0 or later

-

-

  • √: indicates that the item is required on the node.
  • -: indicates that the item is not required on the node.

This feature supports only Hadoop 3.3.4.

Obtaining Software

Table 3 OmniScheduler software package

Software Name

Package Name

Release Type

Description

Download URL

OmniScheduler

BoostKit-loadsmetric-1.0.0-aarch64.zip

Open source

OmniScheduler software package

Link