Thanks, The times were correct via chrony but the timezones were UTC and NZDT which was the issue. Oddly nodes 1 and 2 didnt care about that, only no3 ***shrug***
regards Steven ________________________________ From: Chris Samuel via slurm-users <slurm-users@lists.schedmd.com> Sent: Tuesday, 10 December 2024 4:19 pm To: slurm-users@lists.schedmd.com <slurm-users@lists.schedmd.com> Subject: [slurm-users] Re: node3 not working - down On 9/12/24 5:44 pm, Steven Jones via slurm-users wrote: > [2024-12-09T23:38:56.645] error: Munge decode failed: Rewound credential > [2024-12-09T23:38:56.645] auth/munge: _print_cred: ENCODED: Tue Dec 10 > 23:38:30 2024 > [2024-12-09T23:38:56.645] auth/munge: _print_cred: DECODED: Mon Dec 09 > 23:38:56 2024 > [2024-12-09T23:38:56.645] error: Check for out of sync clocks One system is 24 hours behind/ahead of the other. You should make sure NTP is set up and working on all these nodes. -- Chris Samuel : https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.csamuel.org%2F&data=05%7C02%7Csteven.jones%40vuw.ac.nz%7Cfe8bb9470ea84afe3b4e08dd18cc10ec%7Ccfe63e236951427e8683bb84dcf1d20c%7C0%7C0%7C638693987008953805%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=w5pRqr6%2F1Jf7Gk0OxhB9otiG9o1CyHlkK2yGrXHYfhY%3D&reserved=0<http://www.csamuel.org/> : Berkeley, CA, USA -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
