Thanks Ralph, you were right I was not aware of --kill-on-bad-exit and KillOnBadExit, setting it to 1 shuts down the entire MPI job when MPI_Abort() is called. I was thinking this MPI protocol message was just transported by slurm and then each task would exit. Oh well I should not guess the implementation. :-)
Thanks again. David
