Cluster Software Configuration
Table 1 lists the required software versions.
Software Environment |
Version |
Management Node Server |
Compute Node Agent |
Storage Node HDFS/Ceph |
|---|---|---|---|---|
OS |
openEuler 20.03 LTS SP1 |
Yes |
Yes |
Yes |
JDK |
BiSheng JDK 8u262 |
Yes |
Yes |
Yes |
ZooKeeper |
3.6.2 |
- |
Yes |
- |
Hadoop |
3.2.0 |
Yes |
- |
Yes |
Spark |
3.0.0 |
Yes |
Yes |
- |
Hive |
3.1.0 |
Yes |
Yes |
- |
Ceph |
14.2.8 |
- |
- |
Yes |
Python |
Python3 |
- |
Yes |
Yes |
- You can install the big data engine Spark as required.
- HDFS or Ceph can be used for storage. If the storage deployment mode is HDFS, you are advised to install Kerberos on the management node to ensure cluster security.
Parent topic: Cluster Planning