Environment Requirements
Hardware Requirements
A Ceph cluster can use the hybrid deployment mode of Kunpeng servers and x86 servers or the non-hybrid deployment mode of all Kunpeng servers. In a hybrid deployment, among the three Ceph nodes, two are Kunpeng servers and one is x86 server. Both OpenStack nodes are Kunpeng servers. Each server is equipped with four SAS HDDs, one of which is used as the OS drive, and the other three are used as storage drives. Table 1 describes the hardware environment.
|
Device Type |
Model |
Configuration |
|---|---|---|
|
Ceph1 node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
Ceph2 node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
Ceph3 node |
x86 server |
2 x 28-core 2.1 GHz processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
OpenStack management node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
OpenStack compute node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
In a non-hybrid deployment, all the three Ceph nodes are Kunpeng servers, and both OpenStack nodes are Kunpeng servers. Each server is equipped with four SAS HDDs, one of which is used as the OS drive, and the other three are used as storage drives. Table 2 describes the hardware environment.
|
Device Type |
Model |
Configuration |
|---|---|---|
|
Ceph1 node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
Ceph2 node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
Ceph3 node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
OpenStack management node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
|
OpenStack compute node |
Kunpeng server |
2 x Kunpeng 920 processor, 4 x 32 GB DIMM, and 4 x 1.2 TB SAS HDD |
This document uses the hybrid deployment of Kunpeng and x86 servers as an example to describe how to deploy a Ceph cluster. When Ceph uses the non-hybrid deployment mode, the operations are the same as those in hybrid deployment mode.
Software Environment
Prerequisites:
- Components such as Keystone, Placement, Neutron, Nova, Glance, Cinder, and Swift have been installed in the OpenStack environment. For details, see OpenStack Rocky & Stein Deployment Guide (CentOS 7.6) and OpenStack Queens Deployment Guide (openEuler 20.03).
- The Ceph cluster has been set up, and the MON and OSD processes have been started.
Table 3 describes the software configuration.
Cluster Environment
In this document, five servers are used to deploy the OpenStack+Ceph cluster. Three servers are used as the Ceph cluster, and two servers are used as the OpenStack environment and Ceph client nodes. For details, see Figure 1 and Table 4.
|
Node |
IP Address |
Server Type |
Description |
|---|---|---|---|
|
Ceph1 |
192.168.21.1 |
Kunpeng server |
Ceph cluster Manager (MGR) node, storage node, and Monitor (MON) node. |
|
Ceph2 |
192.168.21.3 |
Kunpeng server |
Ceph cluster storage node and MON node. |
|
Ceph3 |
192.168.21.68 |
x86 server |
Ceph cluster storage node and MON node. |
|
controller |
192.168.21.11 |
Kunpeng server |
OpenStack control node, Swift object storage node, and Ceph client node. |
|
compute |
192.168.21.12 |
Kunpeng server |
OpenStack compute node, Cinder block storage node, and Ceph client node. |