Cluster Software Configuration
Table 1 lists the software versions used in the cluster environment.
Software Environment |
Version |
Management Node Server |
Compute Node Agent |
|---|---|---|---|
OS |
openEuler 20.03 LTS SP1 |
Yes |
Yes |
JDK |
BiSheng JDK 8u262 |
Yes |
Yes |
Hadoop |
3.2.0 |
Yes |
Yes |
Spark |
3.1.1 |
Yes |
Yes |
Hive |
3.1.0 |
Yes |
Yes |
Python |
Python3 |
Yes |
Yes |
- You can install the big data engine Spark as required.
- HDFS is used for storage. You are advised to install Kerberos on the management node to ensure cluster security.
Parent topic: Cluster Planning