Rate This Document
Findability
Accuracy
Completeness
Readability

Other Information

Before configuring this feature, learn about the license requirements, constraints, and principles.

Availability

  • Software versions: Ceph 17.2.7 and UCX 1.14.1
  • License: No license is required.

Constraints

The RDMA network acceleration feature is implemented based on UCX + Ceph 17.2.7. UCX + other distributed storage modes are not supported.

Principles

Native Ceph distributed storage has the following communication frameworks:

  • Simple: basic client-server model. Two threads are created for each connection to transmit and receive messages. The number of threads increases as the number of connections increases.
  • Async: asynchronous communication framework. Message transmission and receipt are processed by an asynchronous message framework, and the processing results are asynchronously sent to application threads. In this mode, the number of threads does not increase as the number of connections increases, but the message transmission and receipt performance deteriorates due to asynchronous waiting. This framework is widely used.
  • XIO: a new communication framework. It has not been put into commercial use.

    The RDMA network acceleration feature applies UCX to the asynchronous framework used by native Ceph distributed storage to enable end-to-end RDMA.