Change Description

The OmniMV materialized view feature of Kunpeng BoostKit for Big Data uses AI algorithms to recommend the optimal materialized view from historical SQL queries, automatically matches user SQL statements with a materialized view in Spark, and uses the matched materialized view in the SQL execution plan. This feature greatly reduces repeated calculations and increases the query efficiency.

Version 1.0.0 has the following changes:

• Supports execution plan rewriting for the Filter, Aggregation, and Join operators.
• Supports Yarn log parsing for extracting valid information such as SQL execution plans and statistics.
• Supports functions such as candidate view generation, cost estimation model training, and view selection model training.
• Supports the Spark engine.