Compression Algorithms

Overview

LZ4 is a widely used compression algorithm with good compression performance. However, its compression ratio is low. In this feature, Huawei-developed algorithms and instruction acceleration are used to improve the compression ratio and write performance.

Technical Principles

The compression algorithm feature uses Huawei-developed compression algorithms, including the dynamic global history information table, hierarchical algorithm model, dynamic compression header, table header structure, NEON instruction optimization, and elastic matching window, to improve the data block compression ratio without decreasing the compression efficiency.

Figure 1 Dynamic global history information table

Figure 2 Elastic matching window

Expected Results

The self-developed compression algorithms improve the compression ratio by 25% compared with LZ4 and improve the write performance by 10% in balanced scenarios.