Preparing the Installation Directory
You can specify the directory for storing the HAF installation package. This document uses the omm user and the cgroup subdirectory omm as an example. During the installation, select /home/omm/omnidata-software as the directory for storing the software installation package and /home/omm/omnidata-install as the software installation directory. After HAF is installed on the compute node, the haf-host directory is generated in /home/omm/omnidata-install. After HAF is installed on the offload node, the haf-offload directory is generated in /home/omm/omnidata-install.
- The HAF installation package contains three software packages: haf-host, haf-target, and haf-tool. After HAF is installed on the compute node, all related files are stored in /home/omm/omnidata-install/haf-host. After HAF is installed on the offload node, all related files are stored in /home/omm/omnidata-install/haf-offload. The haf-tool software package is used to run maintenance commands.
- You can specify the directory for storing the OmniData installation package. In this document, the /home/omm/omnidata-software directory is used as the directory for storing the installation package, and the /home/omm/omnidata-install directory is used as the root directory for installing the software. After the OmniData program package is decompressed, the omnidata and omnidata-setup directories are generated. All related files are stored in /home/omm/omnidata-install/omnidata and /home/omm/omnidata-install/omnidata-setup.
Table 1 describes the installation packages and their installation directories.
The /home/omm/omnidata-software directory is used only to store the installation packages and installation scripts. The /home/omm/omnidata-install directory is used to run services.
Installation Node |
Directory Category |
Directory Name |
Directory Description |
|---|---|---|---|
All nodes (management, compute, and storage nodes) |
Directory for storing software packages |
/home/omm/omnidata-software |
Decompress the BoostKit-haf_1.3.0.zip package to obtain the haf-1.3.0.tar.gz package. The haf-1.3.0.tar.gz package contains the software package, tool script package, and installation configuration file required for HAF installation: haf-host-1.3.0.tar.gz, haf-target-1.3.0.tar.gz, and haf-tool-1.3.0.tar.gz. Stores the software package BoostKit-omnidata_1.5.0.zip required for OmniData installation. NOTE:
Scripts required for installation are contained in haf-tool-1.3.0.tar.gz. Decompress the package before installation. The files and folders generated after decompression are described as follows:
|
Management and compute nodes |
Directory for installing HAF on a compute node |
/home/omm/omnidata-install/haf-host/bin |
Stores software binary files of a compute node, for example, kmc_tool_bin. |
/home/omm/omnidata-install/haf-host/lib |
Stores dynamic libraries and JAR packages of a compute node, for example, libcrypto.so, libhaf_common.so, libhaf_link_host.so, libhaf_offload_host.so, libkmc.so, libkmc_tool.so, liblog.so, libsdp.so, libsecurec.so, libssl.so, and jar/haf-1.3.0.jar. |
||
/home/omm/omnidata-install/haf-host/tools |
|
||
/home/omm/omnidata-install/haf-host/logs |
Default directory for storing logs of a compute node. |
||
/home/omm/omnidata-install/haf-host/env.sh |
Stores the script for setting environment variables of a compute node. |
||
/home/omm/omnidata-install/haf-host/cert |
Stores files including the certificates and keys of a compute node, for example, service.ksfa, service.ksfb, service.prvk, service.pw, service.crt, and ca.crt. |
||
/home/omm/omnidata-install/haf-host/etc |
Stores the configuration files of a compute node, for example, haf_user.conf, LogAuditCfg.json, and LogServiceCfg.json. |
||
/home/omm/omnidata-install/haf-host/conf-bak |
Default path for storing backup configuration files of a compute node. |
||
Offload nodes (storage nodes) |
Installation directory of HAF on each offload node |
/home/omm/omnidata-install/haf-offload/bin |
Stores software binary files on the offload node, for example, kmc_tool_bin. |
/home/omm/omnidata-install/haf-offload/lib |
Stores dynamic libraries and JAR packages of the offload node, for example, libcrypto.so, libffi.so, libhaf_common.so, libhaf_offload_device.so, libhaf_link_target.so, libhostJNI_device.so, libkmc.so, libkmc_tool.so, liblog.so, libsdp.so, libsecurec.so, libssl.so, and jar/haf-1.3.0.jar. |
||
/home/omm/omnidata-install/haf-offload/etc |
|
||
/home/omm/omnidata-install/haf-offload/conf-bak |
Default path for storing configuration files of the offload node. |
||
/home/omm/omnidata-install/haf-offload/env.sh |
Stores the script for setting environment variables of the offload node. |
||
/home/omm/omnidata-install/haf-offload/cert |
Stores files including the certificates and key files of the offload node, for example, service.ksfa, service.ksfb, service.prvk, service.pw, service.crt, ca.crt, and ip_white_list. |
||
/home/omm/omnidata-install/haf-offload/tools |
Stores management tools and scripts of the offload node, for example, haf-tool, scripts, and haf_uninstaller. |
||
/home/omm/omnidata-install/haf-offload/logs |
Default directory for storing offload node logs. |
||
Installation directory of OmniData on the offload node |
/home/omm/omnidata-install/omnidata/deploy |
Stores installation scripts, for example, generate_config.sh, get_ip.py, and log.sh. |
|
/home/omm/omnidata-install/omnidata/etc |
Stores the configuration files required for starting OmniData. |
||
/home/omm/omnidata-install/omnidata/lib |
|
||
/home/omm/omnidata-install/omnidata/plugin |
Stores plugins. |
Planning Installation Nodes
- During the installation, plan a root CA server for issuing authentication certificates to HAF compute and offload nodes. If there is only one node, perform all operations on the node.
- When issuing certificates by using the root CA server, ensure that the time on each node is synchronized. Otherwise, the certificate verification fails due to the system time difference. You can configure NTP for synchronization.
Node |
OmniData Service |
HAF |
Certificate Generation |
Description |
|---|---|---|---|---|
server1 |
- |
✓ |
✓ |
Management node/Root CA server (plan your own root CA server) for issuing certificates. |
agent1 |
- |
✓ |
✓ |
Compute node for HAF offload. |
agent2 |
- |
✓ |
✓ |
Compute node for HAF offload. |
agent3 |
- |
✓ |
✓ |
Compute node for HAF offload. |
ceph1/hdfs1 |
✓ |
✓ |
✓ |
Offload node for operator pushdown using HAF. |
ceph2/hdfs2 |
✓ |
✓ |
✓ |
Offload node for operator pushdown using HAF. |
ceph3/hdfs3 |
✓ |
✓ |
✓ |
Offload node for operator pushdown using HAF. |