Synchronizing the Configuration to Other Nodes
Synchronize the Spark configuration to nodes from agent1 to agent3 to complete the Spark cluster deployment.
- Synchronize spark-3.3.1-bin-hadoop3.2 to the /usr/local directory on agent1 to agent3.
1 2 3
scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent1:/usr/local scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent2:/usr/local scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent3:/usr/local
- Log in to nodes from agent1 to agent3 and create soft links for spark-3.3.1-bin-hadoop3.2.
1 2
cd /usr/local ln -s spark-3.3.1-bin-hadoop3.2 spark
Parent topic: Deploying Spark