Change History

Date	Description
2025-12-30	This issue is the fifth official release. Refined the Spark Porting Guide: Added descriptions about the background and intended audience to Introduction. Added links to Environment Requirements. Refined the descriptions in Installing Base Libraries for step-by-step operations. Refined the step descriptions in Performing Porting Analysis. Added Running and Verifying Spark, explaining how to run and verify Spark. Refined the Spark Deployment Guide: Added descriptions about the background and intended audience in Introduction. Refined Environment Requirements to provide the links for obtaining the OS and software, and added the host name planning. Moved the operation procedures in the sections "Installing Scala," "Deploying and Verifying ZooKeeper," and "Deploying and Verifying Hadoop" to the end of Configuring the Deployment Environment. Refined the descriptions in Standalone Mode, YARN-client Mode, and Test, and refined the original outline and the operation steps. Refined the Spark Tuning Guide: Refined the descriptions in Introduction to Spark to cover the background and intended audience. Refined the descriptions in Tuning Strategy to cover tuning strategies for SQL performance, HiBench scenarios, CPU, and memory resources. Spark Tuning Guide (openEuler): Refined all section titles. Added descriptions about the tuning purpose and refined the procedure descriptions about the tuning method. Deleted sections "sql5", "sql6", "sql8", "sql9", and "sql10". Spark Tuning Guide (CentOS): Added the path to the yarn-site.xml configuration file to Enabling NUMA Awareness. Added two methods for client parameter configurations to Configuring Client Parameters. Refined the descriptions in Calculating Executor Parameters and Tuning HiBench to explain the procedure in steps. Refined the descriptions in Tuning TPC-DS SQL to provide specific suggestions on hardware and software configurations with step-by-step guides. Refined the descriptions in Tuning HiBench to cover the tuning purpose and provide specific tuning suggestions with step-by-step guides. Refined the descriptions in Tuning JDK to cover the tuning purpose and refined the procedure descriptions. Refined the User Guide for Adapting Independent Python Packages to Hybrid-deployed Spark Clusters: Refined the descriptions in Introduction to PySpark. Refined the procedure descriptions in Python Virtual Environment Setup.
2022-04-08	This issue is the fourth official release. Added Tuning Guide (CentOS & openEuler).
2020-07-22	This issue is the third official release. Added User Guide for Adapting Independent Python Packages to Hybrid-deployed Spark Clusters.
2020-04-28	This issue is the second official release. Deleted section "Troubleshooting" from Deployment Guide (CentOS & openEuler).
2019-09-30	This issue is the first official release.