Metadata Acceleration

Overview

As the data volume increases, the read/write amplification of the RocksDB database backend increases exponentially. This acceleration feature optimizes the RocksDB compaction process to mitigate write amplification and improves the execution efficiency of hotspot functions based on Kunpeng instruction optimization.

Technical Principles

1. Metadata compression is used to improve the cache hit rate, and hardware-software collaboration, function tuning, and computing overhead reduction improve the comprehensive capabilities of RocksDB.
2. KAEZstd hardware offload is used to accelerate background compression.
   Figure 1 Metadata acceleration framework
   

Expected Results

1. Compared with the open source RocksDB database, the mixed read/write performance of 64B/128B, 64B/512B, and 64B/1024B key-values is improved by 30% after this feature is enabled.
2. Compared with CPU software compression, the key-value write performance is improved by 10%.