Change Description

The OmniCache materialized view feature uses AI algorithms to recommend the optimal materialized view from historical SQL queries, automatically matches SQL statements with a materialized view in Spark, and replaces the matched materialized view with the existing one in the execution plan of SQL statements. This feature greatly reduces repeated calculations and increases the query efficiency.

Version 1.0.0 supports the following functions:

• Execution plan rewriting for the Filter, Aggregation, and Join operators
• Yarn log parsing for extracting valid information such as SQL execution plans and statistics
• Candidate view generation, cost estimation model training, and view selection model training
• Spark engine