Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

YARN-client Mode

Submit a Spark task in the YARN-client mode to check whether the Spark cluster is successfully deployed.

  1. Submit a Spark task to YARN and enter the spark-shell mode.
    1
    		 
    spark-shell --master yarn --deploy-mode client

  2. Open a browser and enter http://server1:8088 in the address box. The YARN WebUI is displayed. In the task list, find the task you just submitted.

    Change server1 to the IP address of the node where the NameNode is located.

  3. Click Application for a task in the Tracking column. The task detail page shown in Figure 1 is displayed.
    Figure 1 Task detail page
  4. Click ApplicationMaster. The Spark task page is displayed.

    If the redirection fails, you can change server1 in the URL to the actual IP address.

    If the Spark task page shown in Figure 2 is displayed, the task is successfully submitted.

    Figure 2 Spark task page