Rate This Document
Findability
Accuracy
Completeness
Readability

Synchronizing the Configuration to Other Nodes

Synchronize the Spark configuration to nodes from agent1 to agent3 to complete the Spark cluster deployment.

  1. Synchronize spark-3.3.1-bin-hadoop3.2 to the /usr/local directory on agent1 to agent3.
    1
    2
    3
    scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent1:/usr/local
    scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent2:/usr/local
    scp -r /usr/local/spark-3.3.1-bin-hadoop3.2 root@agent3:/usr/local
    
  2. Log in to nodes from agent1 to agent3 and create soft links for spark-3.3.1-bin-hadoop3.2.
    1
    2
    cd /usr/local
    ln -s spark-3.3.1-bin-hadoop3.2 spark