A File Cannot Be Found or Opened When mpirun Is Running on Multiple Nodes
Symptom
- When you run the mpirun command on multiple nodes, an error message is displayed indicating that an .so file cannot be found or opened.
mpirun --allow-run-as-root -np 4 -N 2 --hostfile /hf2 /AllReduce
mpirun: error while loading shared libraries: libopen-rte.so.40: cannot open shared object file: No such file or directory
- When you run the mpirun command on multiple nodes, an error message is displayed indicating that a file cannot be found or opened.
mpirun --allow-run-as-root -np 4 -N 2 --hostfile /hf2 /AllReduce
bash: /Hyper-MPI_x.x.x_aarch64_CentOS7.6_GCCx.x.x_MLNX-OFED5.0/ompi/bin/orted: No such file or directory
Possible Cause
Recovery Procedure
- An .so file cannot be found or opened.
- Use PuTTY to log in to a job execution node as a common Hyper MPI user, for example, hmpi_user.
- Check whether the environment variables are correctly configured. For details, see "Installing and Uninstalling HPCKit" > "Setting Environment Variables" in Kunpeng HPCKit 26.1.RC1 Installation Guide.
- A file cannot be found or opened.
- Use PuTTY to log in to a job execution node as a common Hyper MPI user, for example, hmpi_user.
- Check whether Hyper MPI is installed on all nodes and whether the installation paths of all nodes are the same, or check whether Hyper MPI is installed in the mounted shared directory.
Parent topic: FAQ