Change Description
The OmniRuntime OmniOperator feature of Kunpeng BoostKit for Big Data uses a unified infrastructure to support different engines (such as Spark), reducing repeated optimization work, fully exploring common and heterogeneous computing power, and promoting the Kunpeng ecosystem.
New Features
- Support for Spark 3.4.3 and Spark 3.5.2.
- Added the LIMIT...OFFSET... syntax support to Spark 3.4.3 and 3.5.2.
- New expressions: try_add, try_divide, try_multiply, try_subtract, try_avg, and try_sum
- Added support for the join type and build side co-directional logic of the open source ShuffledHashJoin operator to Spark 3.5.2.
- Added the WindowGroupLimit operator for Spark 3.5.2 to optimize the ROW_NUMBER and RANK function performance for Top-K calculation.
Modified Features
None
Removed Features
This version does not adapt to CentOS 7.9.
Parent topic: V1.8.0