Introduction

The Kunpeng BoostKit for SDS compression algorithm (compression algorithm for short) is a Huawei-developed lossless compression algorithm. It identifies features of raw data and dynamically matches the optimal compression algorithm model to improve the data reduction rate. In addition, instruction-level optimization is performed for Kunpeng processors to accelerate compression. This is applicable to massive data scenarios, such as texts with duplicate content (non-random characters), web pages, databases, and big data. Compared with open-source compression algorithms, the Huawei-proprietary compression algorithm offers a higher compression rate and performance. It provides 25% higher compression rate and 10% higher bandwidth than mainstream open-source compression algorithms.