OHO! You have munge running on the head node, but not on the backends! Okay, all you have to do is set the MCA param “sec” to “basic” in your environment, or add “-mca sec basic” on your cmd line
> On Mar 25, 2015, at 8:53 AM, Mark Santcroos <mark.santcr...@rutgers.edu> > wrote: > > nid25257:09727] sec: munge validate_cred 12345 > [nid25257:09727] sec: munge failed to decode credential: Invalid credential > format > [nid25257:09727] [[9128,0],0] ORTE_ERROR_LOG: Authentication failed in file > ../../../../../orte/mca/oob/tcp/oob_tcp_connection.c at line 803 > [nid25257:09727] [[9128,0],0] mca_oob_tcp_listen_thread: new connection: (17, > 11) 10.128.69.143:34369
