Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

SQL 2 and SQL 7 (CPU-intensive)

Purpose

SQL 2 and SQL 7 are CPU-intensive scenarios. You can optimize Spark executor parameters for the optimal performance.

Procedure

Based on the actual environment, adjust the number of running cores and memory size specified by Spark-Test-Tool in the script/spark-default.conf file to achieve the optimal performance. For example, for the Kunpeng 920 5220 processor, the following executor parameters are recommended for SQL 2 and SQL 7.

1
2
3
4
yarn.executor.num 42
yarn.executor.cores 6
spark.executor.memory 15G
spark.driver.memory 36G