Environment Requirements
The hardware and software environments for installing Ceph 14.2.8 are listed as follows.
Hardware Requirements
Table 1 lists the hardware requirements.
Server |
Kunpeng server |
|---|---|
Processor |
Kunpeng 920 5220 |
Number of Cores |
2 x 32 |
CPU Frequency |
2600 MHz |
Memory Capacity |
8 x 16 GB |
Memory Frequency |
2933 MHz |
NIC |
IN200 NIC (4 x 25GE) |
Drive |
System drives: RAID 1 (2 x 960 GB SATA SSD) Data drives: JBOD enabled in RAID mode (12 x 4 TB SATA HDD) |
Cache drive: 1 x ES3000 V5 3.2 TB |
|
RAID Controller Card |
Avago SAS 3508 |
- The installation of Ceph and its dependencies requires Internet access. Ensure that the server is connected to the Internet.
- If you need to install an OS, you can use the minimum installation mode.
Software Requirements
The software requirements are as follows:
- This document uses Ceph 14.2.8 as an example. You can also refer to this document to compile other versions.
- You can also refer to this document if you use an OS extension version that is not listed in Table 2, such as openEuler 20.03 LTS SP3.
- If the OS needs to be installed, the minimum installation mode is recommended.
Cluster Environment Planning
The cluster consists of Ceph clients and Ceph servers. The clients are client1 to client3, and the servers are ceph1 to ceph3. Figure 1 shows the networking.
Table 3 lists the server IP addresses in the Ceph cluster.
Cluster Node |
Management IP Address |
Public Network |
Cluster Network |
|---|---|---|---|
ceph1 |
192.168.2.166 |
192.168.3.166 |
192.168.4.166 |
ceph2 |
192.168.2.167 |
192.168.3.167 |
192.168.4.167 |
ceph3 |
192.168.2.168 |
192.168.3.168 |
192.168.4.168 |
Table 4 lists the client IP addresses in the Ceph cluster.
Client Node |
Management IP Address |
Public Network |
|---|---|---|
client1 |
192.168.2.160 |
192.168.3.160 |
client2 |
192.168.2.161 |
192.168.3.161 |
client3 |
192.168.2.162 |
192.168.3.162 |
- Management IP address: IP address used for remote SSH machine management and configuration.
- Cluster network IP address: IP address used for data synchronization between nodes in the cluster. The 25GE network port is recommended.
- Public network IP address: IP address of the storage node for other nodes to access. The 25GE network port is recommended.
- When clients are used as presses, ensure that the service port IP addresses of clients and the public network IP addresses of the cluster are in the same network segment. The 25GE network port is recommended.
Drive Partitioning
Ceph 14.2.8 and later versions uses BlueStore as the back-end storage engine. The Journal partition in the Jewel version is no longer used. Instead, the DB partition (metadata partition) and WAL partition are used. Respectively, the two partitions store the metadata and log files generated by the BlueStore back end. In cluster deployment, each Ceph node is configured with twelve 4 TB data drives and one 3.2 TB NVMe drives. One 4 TB data drive functions as the data partition of an OSD, and one NVMe drive functions as the DB and WAL partitions of the 12 OSDs. Generally, the WAL partition needs to be greater than 10 GB. According to the official Ceph document, the recommended size of each DB partition is at least 4% of the capacity of each data drive. The size of each DB partition can be flexibly configured based on the NVMe drive capacity. In this example, the WAL partition capacity is 60 GB and the DB partition capacity is 180 GB.
Table 5 lists the partitions of an OSD.