Introduction

The Kunpeng BoostKit for SDS compression algorithm (compression algorithm for short) is a Huawei-developed lossless compression algorithm. It identifies features of raw data and dynamically matches the optimal compression algorithm model to improve the data reduction rate. In addition, instruction-level optimization is performed for Kunpeng processors to accelerate compression. This is applicable to massive data scenarios, such as texts with duplicate content (non-random characters), web pages, databases, and big data. Compared with open-source compression algorithms, the Huawei-proprietary compression algorithm offers a higher compression rate and performance. It provides 25% higher compression rate and 10% higher bandwidth than mainstream open-source compression algorithms.

This document describes how to enable the compression algorithm in a Ceph cluster. It consists of an open-source patch and a closed-source RPM package. After integrating the compression algorithm into the Ceph source code, compile and deploy Ceph. Then, enable the compression algorithm using Ceph command lines.