[slurm-users] Problem with permisions. CentOS 7.8

[Ferran Planas Padros]

Hello,


I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
Slurm version I have installed is 14.03.3 along with Munge 0.5.11.

I know these are not the latest versions, but I wanted to have consistency in 
all my nodes.


I am facing a problem when I try to start Munge in the nodes with CentOS 7.8. 
Anytime I want to start Munge (service munge start) I get the error that I 
detail below.


'munged[36385]: munged: Error: Failed to check logfile 
"/var/log/munge/munged.log": Permission denied'


I run the command as slurm user, and the /var/log/munge folder does belong to 
slurm.


I have the exact same setup on older nodes which are working under CentOS 6.6 
and 6.5, and there I have no problem. At the end of the year we plan to migrate 
all nodes to CentOS 7.x, and I really need to understand what is happening here.


Best,

Ferran

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Rodrigo Santibáñez]

Hello,

You could find the solution here
https://wiki.fysik.dtu.dk/niflheim/Slurm_installation

Best regards

El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros 
escribió:

> Hello,
>
>
> I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64.
> The Slurm version I have installed is 14.03.3 along with Munge 0.5.11.
>
> I know these are not the latest versions, but I wanted to have consistency
> in all my nodes.
>
>
> I am facing a problem when I try to start Munge in the nodes with CentOS
> 7.8. Anytime I want to start Munge (service munge start) I get the error
> that I detail below.
>
>
> 'munged[36385]: munged: Error: Failed to check logfile
> "/var/log/munge/munged.log": Permission denied'
>
>
> I run the command as slurm user, and the /var/log/munge folder does belong
> to slurm.
>
>
> I have the exact same setup on older nodes which are working under CentOS
> 6.6 and 6.5, and there I have no problem. At the end of the year we plan to
> migrate all nodes to CentOS 7.x, and I really need to understand what is
> happening here.
>
>
> Best,
>
> Ferran
>

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Ferran Planas Padros]

Hi Rodrigo,


I am already following the instructions, but when I start munge it does not 
work. I get this error (on journalctl):


munged: Error: Failed to check logfile "/var/log/munge/munged.log": Permission 
denied


But, I insist, the ownership is correctly set


If I run munge -n I get:

/var/run/munge/munge.socket.2


munge.log is not writing any lines when I run this command.


Best,

Ferran




From: slurm-users  on behalf of Steven 
Senator (slurm-dev-list) 
Sent: Thursday, May 28, 2020 7:10:26 PM
To: Slurm User Community List
Subject: Re: [slurm-users] Problem with permisions. CentOS 7.8

What is in /var/log/munge/munged.log?
Munge is quite strict about permissions in its whole hierarchy of
control and configuration files, appropriately.

On Thu, May 28, 2020 at 11:01 AM Rodrigo Santibáñez
 wrote:
>
> Hello,
>
> You could find the solution here
> https://wiki.fysik.dtu.dk/niflheim/Slurm_installation
>
> Best regards
>
> El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros  
> escribió:
>>
>> Hello,
>>
>>
>> I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
>> Slurm version I have installed is 14.03.3 along with Munge 0.5.11.
>>
>> I know these are not the latest versions, but I wanted to have consistency 
>> in all my nodes.
>>
>>
>> I am facing a problem when I try to start Munge in the nodes with CentOS 
>> 7.8. Anytime I want to start Munge (service munge start) I get the error 
>> that I detail below.
>>
>>
>> 'munged[36385]: munged: Error: Failed to check logfile 
>> "/var/log/munge/munged.log": Permission denied'
>>
>>
>> I run the command as slurm user, and the /var/log/munge folder does belong 
>> to slurm.
>>
>>
>> I have the exact same setup on older nodes which are working under CentOS 
>> 6.6 and 6.5, and there I have no problem. At the end of the year we plan to 
>> migrate all nodes to CentOS 7.x, and I really need to understand what is 
>> happening here.
>>
>>
>> Best,
>>
>> Ferran

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Ree, Jan-Albert van]

Have you checked if SELinux is perhaps blocking this?

Give a 'getenforce' command. If it reports back 'Enforcing' , then issue 
'setenforce 0' and retry


Regards,

--

Jan-Albert van Ree

Jan-Albert van Ree | HPC Specialist | Digital Services
MARIN | T +31 317 49 35 48 | j.a.v@marin.nl | 
www.marin.nl

[LinkedIn] [YouTube] 
  [Twitter] 
  [Facebook] 

MARIN news: May 26-29, The Future of Ocean Energy and Shipping 
online


From: slurm-users  on behalf of Ferran 
Planas Padros 
Sent: Thursday, May 28, 2020 20:20
To: Slurm User Community List
Subject: Re: [slurm-users] Problem with permisions. CentOS 7.8


Hi Rodrigo,


I am already following the instructions, but when I start munge it does not 
work. I get this error (on journalctl):


munged: Error: Failed to check logfile "/var/log/munge/munged.log": Permission 
denied


But, I insist, the ownership is correctly set


If I run munge -n I get:

/var/run/munge/munge.socket.2


munge.log is not writing any lines when I run this command.


Best,

Ferran




From: slurm-users  on behalf of Steven 
Senator (slurm-dev-list) 
Sent: Thursday, May 28, 2020 7:10:26 PM
To: Slurm User Community List
Subject: Re: [slurm-users] Problem with permisions. CentOS 7.8

What is in /var/log/munge/munged.log?
Munge is quite strict about permissions in its whole hierarchy of
control and configuration files, appropriately.

On Thu, May 28, 2020 at 11:01 AM Rodrigo Santibáñez
 wrote:
>
> Hello,
>
> You could find the solution here
> https://wiki.fysik.dtu.dk/niflheim/Slurm_installation
>
> Best regards
>
> El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros  
> escribió:
>>
>> Hello,
>>
>>
>> I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
>> Slurm version I have installed is 14.03.3 along with Munge 0.5.11.
>>
>> I know these are not the latest versions, but I wanted to have consistency 
>> in all my nodes.
>>
>>
>> I am facing a problem when I try to start Munge in the nodes with CentOS 
>> 7.8. Anytime I want to start Munge (service munge start) I get the error 
>> that I detail below.
>>
>>
>> 'munged[36385]: munged: Error: Failed to check logfile 
>> "/var/log/munge/munged.log": Permission denied'
>>
>>
>> I run the command as slurm user, and the /var/log/munge folder does belong 
>> to slurm.
>>
>>
>> I have the exact same setup on older nodes which are working under CentOS 
>> 6.6 and 6.5, and there I have no problem. At the end of the year we plan to 
>> migrate all nodes to CentOS 7.x, and I really need to understand what is 
>> happening here.
>>
>>
>> Best,
>>
>> Ferran




Help us improve the spam filter. If this message contains SPAM, click 
here
 to report. Thank you, MARIN Support Group

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Ole Holm Nielsen]

Good check, but I don't believe it is necessary to disable SELinux in 
order to run Munge correctly.  Our slurmctld server (CentOS 7.8) reports 
Enforcing.


/Ole


On 28-05-2020 20:37, Ree, Jan-Albert van wrote:

Have you checked if SELinux is perhaps blocking this?

Give a 'getenforce' command. If it reports back 'Enforcing' , then issue 
'setenforce 0' and retry



Regards,

--

Jan-Albert van Ree


Jan-Albertvan Ree| HPC Specialist| Digital Services
MARIN| T +31 317 49 35 48| j.a.v@marin.nl 
 | www.marin.nl 


LinkedIn  YouTube 
 Twitter 
 Facebook 

MARIN news: May 26-29, The Future of Ocean Energy and Shipping online 
 




*From:* slurm-users  on behalf of 
Ferran Planas Padros 

*Sent:* Thursday, May 28, 2020 20:20
*To:* Slurm User Community List
*Subject:* Re: [slurm-users] Problem with permisions. CentOS 7.8

Hi Rodrigo,


I am already following the instructions, but when I start munge it does 
not work. I get this error (on journalctl):



munged: Error: Failed to check logfile "/var/log/munge/munged.log": 
Permission denied



But, I insist, the ownership is correctly set


If I run munge -n I get:

/var/run/munge/munge.socket.2


munge.log is not writing any lines when I run this command.


Best,

Ferran




*From:* slurm-users  on behalf of 
Steven Senator (slurm-dev-list) 

*Sent:* Thursday, May 28, 2020 7:10:26 PM
*To:* Slurm User Community List
*Subject:* Re: [slurm-users] Problem with permisions. CentOS 7.8
What is in /var/log/munge/munged.log?
Munge is quite strict about permissions in its whole hierarchy of
control and configuration files, appropriately.

On Thu, May 28, 2020 at 11:01 AM Rodrigo Santibáñez
 wrote:


Hello,

You could find the solution here
https://wiki.fysik.dtu.dk/niflheim/Slurm_installation

Best regards

El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros  
escribió:


Hello,


I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
Slurm version I have installed is 14.03.3 along with Munge 0.5.11.

I know these are not the latest versions, but I wanted to have consistency in 
all my nodes.


I am facing a problem when I try to start Munge in the nodes with CentOS 7.8. 
Anytime I want to start Munge (service munge start) I get the error that I 
detail below.


'munged[36385]: munged: Error: Failed to check logfile 
"/var/log/munge/munged.log": Permission denied'


I run the command as slurm user, and the /var/log/munge folder does belong to 
slurm.


I have the exact same setup on older nodes which are working under CentOS 6.6 
and 6.5, and there I have no problem. At the end of the year we plan to migrate 
all nodes to CentOS 7.x, and I really need to understand what is happening here.


Best,

Ferran

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Steven Senator (slurm-dev-list)]

What is in /var/log/munge/munged.log?
Munge is quite strict about permissions in its whole hierarchy of
control and configuration files, appropriately.

On Thu, May 28, 2020 at 11:01 AM Rodrigo Santibáñez
 wrote:
>
> Hello,
>
> You could find the solution here
> https://wiki.fysik.dtu.dk/niflheim/Slurm_installation
>
> Best regards
>
> El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros  
> escribió:
>>
>> Hello,
>>
>>
>> I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
>> Slurm version I have installed is 14.03.3 along with Munge 0.5.11.
>>
>> I know these are not the latest versions, but I wanted to have consistency 
>> in all my nodes.
>>
>>
>> I am facing a problem when I try to start Munge in the nodes with CentOS 
>> 7.8. Anytime I want to start Munge (service munge start) I get the error 
>> that I detail below.
>>
>>
>> 'munged[36385]: munged: Error: Failed to check logfile 
>> "/var/log/munge/munged.log": Permission denied'
>>
>>
>> I run the command as slurm user, and the /var/log/munge folder does belong 
>> to slurm.
>>
>>
>> I have the exact same setup on older nodes which are working under CentOS 
>> 6.6 and 6.5, and there I have no problem. At the end of the year we plan to 
>> migrate all nodes to CentOS 7.x, and I really need to understand what is 
>> happening here.
>>
>>
>> Best,
>>
>> Ferran

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Ole Holm Nielsen]

Hi Ferran,

Normally the munge and slurm services are run by two distinct users, but 
you said that you run munge as the slurm user?


Questions:

1. Did you install the munge RPM from EPEL?

2. Did you check the instructions in 
https://wiki.fysik.dtu.dk/niflheim/Slurm_installation#munge-configuration-and-testing 
?


Best regards,
Ole

On 28-05-2020 20:20, Ferran Planas Padros wrote:

Hi Rodrigo,


I am already following the instructions, but when I start munge it does 
not work. I get this error (on journalctl):



munged: Error: Failed to check logfile "/var/log/munge/munged.log": 
Permission denied



But, I insist, the ownership is correctly set


If I run munge -n I get:

/var/run/munge/munge.socket.2


munge.log is not writing any lines when I run this command.


Best,

Ferran




*From:* slurm-users  on behalf of 
Steven Senator (slurm-dev-list) 

*Sent:* Thursday, May 28, 2020 7:10:26 PM
*To:* Slurm User Community List
*Subject:* Re: [slurm-users] Problem with permisions. CentOS 7.8
What is in /var/log/munge/munged.log?
Munge is quite strict about permissions in its whole hierarchy of
control and configuration files, appropriately.

On Thu, May 28, 2020 at 11:01 AM Rodrigo Santibáñez
 wrote:


Hello,

You could find the solution here
https://wiki.fysik.dtu.dk/niflheim/Slurm_installation

Best regards

El jue., 28 de mayo de 2020 12:55, Ferran Planas Padros  
escribió:


Hello,


I have installed Slurm under CentOS 7.8 Kernel 3.10.0-1127.el7.x86_64. The 
Slurm version I have installed is 14.03.3 along with Munge 0.5.11.

I know these are not the latest versions, but I wanted to have consistency in 
all my nodes.


I am facing a problem when I try to start Munge in the nodes with CentOS 7.8. 
Anytime I want to start Munge (service munge start) I get the error that I 
detail below.


'munged[36385]: munged: Error: Failed to check logfile 
"/var/log/munge/munged.log": Permission denied'


I run the command as slurm user, and the /var/log/munge folder does belong to 
slurm.


I have the exact same setup on older nodes which are working under CentOS 6.6 
and 6.5, and there I have no problem. At the end of the year we plan to migrate 
all nodes to CentOS 7.x, and I really need to understand what is happening here.

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Bjørn-Helge Mevik]

Ferran Planas Padros  writes:

> I run the command as slurm user, and the /var/log/munge folder does belong to 
> slurm.

For security reasons, I strongly advise that you run munged as a
separate user, which is unprivileged and not used for anything else.

-- 
Regards,
Bjørn-Helge Mevik, dr. scient,
Department for Research Computing, University of Oslo


signature.asc
Description: PGP signature

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Sudeep Narayan Banerjee]

I have not checked on the CentOS7.8
a) if /var/run/munge folder does not exist then please double check whether
munge has been installed or not
b) user root or sudo user to do
ps -ef | grep munge
kill -9  //where PID is the Process ID for munge (if the process is
running at all); else

which munged
/etc/init.d/munge start

please let me know the the output of:

$ munge -n

$ munge -n | unmunge

$ sudo systemctl status --full munge

Thanks & Regards,
Sudeep Narayan Banerjee
System Analyst | Scientist B
Indian Institute of Technology Gandhinagar
Gujarat, INDIA


On Fri, May 29, 2020 at 11:55 AM Bjørn-Helge Mevik 
wrote:

> Ferran Planas Padros  writes:
>
> > I run the command as slurm user, and the /var/log/munge folder does
> belong to slurm.
>
> For security reasons, I strongly advise that you run munged as a
> separate user, which is unprivileged and not used for anything else.
>
> --
> Regards,
> Bjørn-Helge Mevik, dr. scient,
> Department for Research Computing, University of Oslo
>

Re: [slurm-users] Problem with permisions. CentOS 7.8

[Sudeep Narayan Banerjee]

also check:
a) whether NTP has been setup and communicating with master node
b) iptables may be flushed (iptables -L)
c) SeLinux to disabled, to check :
getenforce
vim /etc/sysconfig/selinux
(change SELINUX=enforcing to SELINUX=disabled and save the file and reboot)

Thanks & Regards,
Sudeep Narayan Banerjee


On Fri, May 29, 2020 at 12:08 PM Sudeep Narayan Banerjee <
snbaner...@iitgn.ac.in> wrote:

> I have not checked on the CentOS7.8
> a) if /var/run/munge folder does not exist then please double check
> whether munge has been installed or not
> b) user root or sudo user to do
> ps -ef | grep munge
> kill -9  //where PID is the Process ID for munge (if the process is
> running at all); else
>
> which munged
> /etc/init.d/munge start
>
> please let me know the the output of:
>
> $ munge -n
>
> $ munge -n | unmunge
>
> $ sudo systemctl status --full munge
>
> Thanks & Regards,
> Sudeep Narayan Banerjee
> System Analyst | Scientist B
> Indian Institute of Technology Gandhinagar
> Gujarat, INDIA
>
>
> On Fri, May 29, 2020 at 11:55 AM Bjørn-Helge Mevik 
> wrote:
>
>> Ferran Planas Padros  writes:
>>
>> > I run the command as slurm user, and the /var/log/munge folder does
>> belong to slurm.
>>
>> For security reasons, I strongly advise that you run munged as a
>> separate user, which is unprivileged and not used for anything else.
>>
>> --
>> Regards,
>> Bjørn-Helge Mevik, dr. scient,
>> Department for Research Computing, University of Oslo
>>
>