我要评分
获取效率
正确性
完整性
易理解

Change Description

In addition to the External Shuffle Service (ESS) mode, the Remote Shuffle Service (RSS) mode is added. The RSS works on decoupled storage and compute architecture. By optimizing the Spark shuffle write process, BoostRSS saves the data generated in the Map stage to RSS nodes. In this way, the original small files and small I/O operations are aggregated into efficient large files and continuous large I/O operations. The RSS significantly improves the overall drive read and write efficiency and alleviates the I/O burden on compute nodes. As a result, MapReduce task execution performance increases.

New Features

  • RSS mode, which implements faster processing.
  • Replicas, which enhance reliability in fault or error scenarios.
  • Traffic control and load balancing, which optimize resource allocation.

Modified Features

None

Removed Features

None