Prerequisites
Before deploying OmniData, ensure that the following software has been installed in the cluster.
Engine That Uses OmniData |
Required Components |
|---|---|
Spark |
OS, JDK, ZooKeeper, Hadoop, Spark, Hive, or Ceph (use either Ceph or HDFS) |
Hive |
OS, JDK, ZooKeeper, Hadoop, Hive, or Ceph (use either Ceph or HDFS) |
- A prerequisite for batch installation using SmartKit is that the passwords of all nodes must be the same.
- You can select a cluster mode based on the application scenario requirements. The secure mode (Kerberos) is recommended if the storage deployment mode is HDFS.
- As a service process, OmniData uses HAF to offload compute node tasks to the remote end for execution.
- If a Ceph cluster is used, after the deployment is complete, add the rgw_nfs_lru_lane_hiwat configuration item to the [global] section in the Ceph configuration file /etc/ceph/ceph.conf and set the value to 65535. For details, see TPC-DS SQL3 Error.
Parent topic: Environment Requirements