Prerequisites
Before deploying OmniData, ensure that the following software has been installed in the cluster.
Engine That Uses OmniData |
Required Components |
|---|---|
Spark |
OS, JDK, ZooKeeper, Hadoop, Spark, Hive, or Ceph (use either Ceph or HDFS) |
- A prerequisite for batch installation using SmartKit is that the passwords of all nodes must be the same.
- You can select a cluster mode based on the application scenario requirements. The security mode (Kerberos) is recommended if the storage deployment mode is HDFS.
- As an application service, OmniData is deployed and managed by using HAF.
- If the Ceph cluster is used, after the deployment is complete, add the rgw_nfs_lru_lane_hiwat configuration item to the [global] section in the Ceph configuration file /etc/ceph/ceph.conf and set the value to 65535. For details, see TPCDS SQL3 Error.
Parent topic: Environment Requirements