Change Description
The OmniAdvisor parameter tuning feature of Kunpeng BoostKit for Big Data aims to use AI algorithms to intelligently tune the parameters of Spark and Hive tasks running in online systems.
Version 1.0.0 has the following changes:
- Log parsing: Historical task run logs of Spark and Hive Tez can be parsed.
- Parameter tuning: Parameters of historical tasks can be tuned for Spark and Hive Tez. You can add parameters and set parameter ranges.
- Intelligent parameter recommendation: After tuning is complete, the system automatically recommends the optimal parameter settings based on historical results and automatically applies recommended parameters to subsequent tasks.
Parent topic: V1.0.0