Hi, Good morning.
I am using openmpi/4.0.3 on Compute Canada to do 3D flow simulation. My grid size is Lx*Ly*Lz=700*169*500. It worked quite well for lower resolution. However, after increasing my resolution from Nx*Ny*Nz=64*109*62 to 256*131*192, openmpi reported errors as shown below: [gra541:21749] *** An error occurred in MPI_Recv [gra541:21749] *** reported by process [2068774913,140] [gra541:21749] *** on communicator MPI COMMUNICATOR 13 DUP FROM 0 [gra541:21749] *** MPI_ERR_TAG: invalid tag [gra541:21749] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort, [gra541:21749] *** and potentially your MPI job) [gra529:07588] 210 more processes have sent help message help-mpi-errors.txt / mpi_errors_are_fatal [gra529:07588] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages This is my computation parameters and command to run openmpi: #!/bin/bash #SBATCH --time=0-10:00:00 #SBATCH --job-name=3D_EIT_Wi64 #SBATCH --output=log-%j #SBATCH --ntasks=128 #SBATCH --nodes=4 #SBATCH --mem-per-cpu=4000M mpirun ./vepoiseuilleFD_5.x I guess The value of the PATH and LD_LIBRARY_PATH environment variables are all set correct because my simulation worked for lower resolution ones. Thank you for your time. Sincerely Wade
