KAE and KSAL for HDFS

Overview

The EC algorithm of open source HDFS is replaced with the KSAL EC algorithm to improve the computing efficiency. KAE hardware-based compression is enabled to enhance data flushing.

Technical Principles

Figure 1 KAE and KSAL acceleration for HDFS

Expected Results

The cluster throughput is improved by 20% after the optimization.