[slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04
Hi Ole, Thanks for the link. But then I'm back where I actually wanted to stay away from. Compiling slurm myself. If that's the only solution then that's what I'll do. But it still seems to me that there are more users with Ubuntu 24.04 who use a MySQL/MariaDB as a back-end for storing accounting data. Regards, Karl -Original Message- From: Ole Holm Nielsen via slurm-users Sent: Monday, 27 January 2025 13:49 To: slurm-users@lists.schedmd.com Subject: [slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04 Hi Karl, I recommend to read the Slurm quickstart documentation at https://slurm.schedmd.com/quickstart_admin.html#debuild > Building Debian Packages > > Beginning with Slurm 23.11.0, Slurm includes the files required to build > Debian packages. These packages conflict with the packages shipped with > Debian based distributions, and are named distinctly to differentiate them. > After downloading the desired version of Slurm, the following can be done to > build the packages: IHTH, Ole On 1/27/25 12:00, karl--- via slurm-users wrote: > Hello, > > Last weekend, I updated my server to ubuntu 24.04 and instead of using > my own compiled version of slurm, I switched to > > the version (23.11.4) that comes with Ubuntu 24.04. Since then, I have > been having problems with slurmdbd. > > I get the following error message: > > slurmdbd: error: issue making get_lineage procedure > > slurmdbd: accounting_storage/as_mysql: init: Accounting storage MYSQL > plugin failed > > slurmdbd: debug2: wsrep_on=0 > > slurmdbd: error: Couldn't load specified plugin name for > accounting_storage/mysql: Plugin init() callback failed > > slurmdbd: error: cannot create accounting_storage context for > accounting_storage/mysql > > slurmdbd: fatal: Unable to initialize accounting_storage/mysql > accounting storage plugin > > My /etc/slurm/slurmdbd.conf looks like this: > > AuthType=auth/munge > > DebugLevel=debug5 > > DbdHost=localhost > > DbdPort=3306 > > StorageLoc=slurm_acct_db > > StoragePass= > > StorageType=accounting_storage/mysql > > StorageUser=slurm > > SlurmUser=admina > > PluginDir=/usr/lib/x86_64-linux-gnu/slurm-wlm > > ArchiveEvents=yes > > ArchiveJobs=yes > > ArchiveResvs=yes > > ArchiveSteps=no > > ArchiveSuspend=no > > ArchiveTXN=no > > ArchiveUsage=no > > AuthInfo=/var/run/munge/munge.socket.2 > > PurgeEventAfter=1month > > PurgeJobAfter=12month > > PurgeResvAfter=1month > > PurgeStepAfter=1month > > PurgeSuspendAfter=1month > > PurgeTXNAfter=12month > > PurgeUsageAfter=24month > > LogFile=/var/log/slurm/slurmdbd.log > > PidFile=/var/run/slurmdbd.pid > > NOTE: Removing the PluginDir directive makes no difference. > > And the Plugin directory contains the accounting/MySQL file: > > ls -al /usr/lib/x86_64-linux-gnu/slurm-wlm/*mysql* > > -rw-r--r-- 1 root root 3145992 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.a > > -rw-r--r-- 1 root root 1071 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.la > > -rw-r--r-- 1 root root 501848 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.so > > I checked already the threat on: > https://groups.google.com/g/slurm-users/ > c/wRV8o7qqGi4 <https://groups.google.com/g/slurm-users/c/wRV8o7qqGi4> > > Any idea what is going on here? > > Regards, > > Karl -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
[slurm-users] Problems with slurmdbd on Ubuntu 24.04
Hello, Last weekend, I updated my server to ubuntu 24.04 and instead of using my own compiled version of slurm, I switched to the version (23.11.4) that comes with Ubuntu 24.04. Since then, I have been having problems with slurmdbd. I get the following error message: slurmdbd: error: issue making get_lineage procedure slurmdbd: accounting_storage/as_mysql: init: Accounting storage MYSQL plugin failed slurmdbd: debug2: wsrep_on=0 slurmdbd: error: Couldn't load specified plugin name for accounting_storage/mysql: Plugin init() callback failed slurmdbd: error: cannot create accounting_storage context for accounting_storage/mysql slurmdbd: fatal: Unable to initialize accounting_storage/mysql accounting storage plugin My /etc/slurm/slurmdbd.conf looks like this: AuthType=auth/munge DebugLevel=debug5 DbdHost=localhost DbdPort=3306 StorageLoc=slurm_acct_db StoragePass= StorageType=accounting_storage/mysql StorageUser=slurm SlurmUser=admina PluginDir=/usr/lib/x86_64-linux-gnu/slurm-wlm ArchiveEvents=yes ArchiveJobs=yes ArchiveResvs=yes ArchiveSteps=no ArchiveSuspend=no ArchiveTXN=no ArchiveUsage=no AuthInfo=/var/run/munge/munge.socket.2 PurgeEventAfter=1month PurgeJobAfter=12month PurgeResvAfter=1month PurgeStepAfter=1month PurgeSuspendAfter=1month PurgeTXNAfter=12month PurgeUsageAfter=24month LogFile=/var/log/slurm/slurmdbd.log PidFile=/var/run/slurmdbd.pid NOTE: Removing the PluginDir directive makes no difference. And the Plugin directory contains the accounting/MySQL file: ls -al /usr/lib/x86_64-linux-gnu/slurm-wlm/*mysql* -rw-r--r-- 1 root root 3145992 Apr 1 2024 /usr/lib/x86_64-linux-gnu/slurm-wlm/accounting_storage_mysql.a -rw-r--r-- 1 root root 1071 Apr 1 2024 /usr/lib/x86_64-linux-gnu/slurm-wlm/accounting_storage_mysql.la -rw-r--r-- 1 root root 501848 Apr 1 2024 /usr/lib/x86_64-linux-gnu/slurm-wlm/accounting_storage_mysql.so I checked already the threat on: https://groups.google.com/g/slurm-users/c/wRV8o7qqGi4 Any idea what is going on here? Regards, Karl -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
[slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04
Hi Oe, Found this error also in the logfile: slurmdbd: error: mysql_query failed: 1728 Cannot load from mysql.proc. The table is probably corrupted started: mysql_upgrade -u root -pxxx and this fixes the problem. Went from mysql on 20.04 to mariadb on 24.04. and the database wasn't upgraded. And I had to remove the DbdPort from my conifig file. Thanks, Karl -Original Message- From: karl--- via slurm-users Sent: Monday, 27 January 2025 14:00 To: 'Ole Holm Nielsen' ; slurm-users@lists.schedmd.com Subject: [slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04 Hi Ole, Thanks for the link. But then I'm back where I actually wanted to stay away from. Compiling slurm myself. If that's the only solution then that's what I'll do. But it still seems to me that there are more users with Ubuntu 24.04 who use a MySQL/MariaDB as a back-end for storing accounting data. Regards, Karl -Original Message- From: Ole Holm Nielsen via slurm-users Sent: Monday, 27 January 2025 13:49 To: slurm-users@lists.schedmd.com Subject: [slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04 Hi Karl, I recommend to read the Slurm quickstart documentation at https://slurm.schedmd.com/quickstart_admin.html#debuild > Building Debian Packages > > Beginning with Slurm 23.11.0, Slurm includes the files required to build > Debian packages. These packages conflict with the packages shipped with > Debian based distributions, and are named distinctly to differentiate them. > After downloading the desired version of Slurm, the following can be done to > build the packages: IHTH, Ole On 1/27/25 12:00, karl--- via slurm-users wrote: > Hello, > > Last weekend, I updated my server to ubuntu 24.04 and instead of using > my own compiled version of slurm, I switched to > > the version (23.11.4) that comes with Ubuntu 24.04. Since then, I have > been having problems with slurmdbd. > > I get the following error message: > > slurmdbd: error: issue making get_lineage procedure > > slurmdbd: accounting_storage/as_mysql: init: Accounting storage MYSQL > plugin failed > > slurmdbd: debug2: wsrep_on=0 > > slurmdbd: error: Couldn't load specified plugin name for > accounting_storage/mysql: Plugin init() callback failed > > slurmdbd: error: cannot create accounting_storage context for > accounting_storage/mysql > > slurmdbd: fatal: Unable to initialize accounting_storage/mysql > accounting storage plugin > > My /etc/slurm/slurmdbd.conf looks like this: > > AuthType=auth/munge > > DebugLevel=debug5 > > DbdHost=localhost > > DbdPort=3306 > > StorageLoc=slurm_acct_db > > StoragePass= > > StorageType=accounting_storage/mysql > > StorageUser=slurm > > SlurmUser=admina > > PluginDir=/usr/lib/x86_64-linux-gnu/slurm-wlm > > ArchiveEvents=yes > > ArchiveJobs=yes > > ArchiveResvs=yes > > ArchiveSteps=no > > ArchiveSuspend=no > > ArchiveTXN=no > > ArchiveUsage=no > > AuthInfo=/var/run/munge/munge.socket.2 > > PurgeEventAfter=1month > > PurgeJobAfter=12month > > PurgeResvAfter=1month > > PurgeStepAfter=1month > > PurgeSuspendAfter=1month > > PurgeTXNAfter=12month > > PurgeUsageAfter=24month > > LogFile=/var/log/slurm/slurmdbd.log > > PidFile=/var/run/slurmdbd.pid > > NOTE: Removing the PluginDir directive makes no difference. > > And the Plugin directory contains the accounting/MySQL file: > > ls -al /usr/lib/x86_64-linux-gnu/slurm-wlm/*mysql* > > -rw-r--r-- 1 root root 3145992 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.a > > -rw-r--r-- 1 root root 1071 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.la > > -rw-r--r-- 1 root root 501848 Apr 1 2024 > /usr/lib/x86_64-linux-gnu/slurm- wlm/accounting_storage_mysql.so > > I checked already the threat on: > https://groups.google.com/g/slurm-users/ > c/wRV8o7qqGi4 <https://groups.google.com/g/slurm-users/c/wRV8o7qqGi4> > > Any idea what is going on here? > > Regards, > > Karl -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
[slurm-users] Re: Problems with slurmdbd on Ubuntu 24.04
Hi Stpehan, It is there: root@vrfcanalyzer:/usr/lib/x86_64-linux-gnu/slurm-wlm# ls -al *mysql* -rw-r--r-- 1 root root 3145992 Apr 1 2024 accounting_storage_mysql.a -rw-r--r-- 1 root root1071 Apr 1 2024 accounting_storage_mysql.la -rw-r--r-- 1 root root 501848 Apr 1 2024 accounting_storage_mysql.so -rw-r--r-- 1 root root 213700 Apr 1 2024 jobcomp_mysql.a -rw-r--r-- 1 root root 994 Apr 1 2024 jobcomp_mysql.la -rw-r--r-- 1 root root 44240 Apr 1 2024 jobcomp_mysql.so dpkg -S jobcomp_mysql.so slurm-wlm-mysql-plugin: /usr/lib/x86_64-linux-gnu/slurm-wlm/jobcomp_mysql.so root@vrfcanalyzer:/usr/lib/x86_64-linux-gnu/slurm-wlm# -Original Message- From: Stephan Roth Sent: Monday, 27 January 2025 13:23 To: k...@lovink.net; slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Problems with slurmdbd on Ubuntu 24.04 Hello Karl, I quickly downloaded slurm-wlm-mysql-plugin_23.11.4-1.2ubuntu5_amd64.deb, unpacked it and saw these contents:ä usr/ ├── lib │ └── x86_64-linux-gnu │ └── slurm-wlm │ ├── accounting_storage_mysql.so │ └── jobcomp_mysql.so └── share ├── doc │ └── slurm-wlm-mysql-plugin │ ├── changelog.Debian.gz -> ../slurm-wlm-basic-plugins/changelog.Debian.gz │ └── copyright └── lintian └── overrides └── slurm-wlm-mysql-plugin So it seems to me you're somehow missing /usr/lib/x86_64-linux-gnu/slurm-wlm/jobcomp_mysql.so Does that help? Best, Stephan On 27.01.25 12:00, karl--- via slurm-users wrote: > Hello, > > Last weekend, I updated my server to ubuntu 24.04 and instead of using > my own compiled version of slurm, I switched to > > the version (23.11.4) that comes with Ubuntu 24.04. Since then, I have > been having problems with slurmdbd. > > I get the following error message: > > slurmdbd: error: issue making get_lineage procedure > > slurmdbd: accounting_storage/as_mysql: init: Accounting storage MYSQL > plugin failed > > slurmdbd: debug2: wsrep_on=0 > > slurmdbd: error: Couldn't load specified plugin name for > accounting_storage/mysql: Plugin init() callback failed > > slurmdbd: error: cannot create accounting_storage context for > accounting_storage/mysql > > slurmdbd: fatal: Unable to initialize accounting_storage/mysql > accounting storage plugin > > My /etc/slurm/slurmdbd.conf looks like this: > > AuthType=auth/munge > > DebugLevel=debug5 > > DbdHost=localhost > > DbdPort=3306 > > StorageLoc=slurm_acct_db > > StoragePass= > > StorageType=accounting_storage/mysql > > StorageUser=slurm > > SlurmUser=admina > > PluginDir=/usr/lib/x86_64-linux-gnu/slurm-wlm > > ArchiveEvents=yes > > ArchiveJobs=yes > > ArchiveResvs=yes > > ArchiveSteps=no > > ArchiveSuspend=no > > ArchiveTXN=no > > ArchiveUsage=no > > AuthInfo=/var/run/munge/munge.socket.2 > > PurgeEventAfter=1month > > PurgeJobAfter=12month > > PurgeResvAfter=1month > > PurgeStepAfter=1month > > PurgeSuspendAfter=1month > > PurgeTXNAfter=12month > > PurgeUsageAfter=24month > > LogFile=/var/log/slurm/slurmdbd.log > > PidFile=/var/run/slurmdbd.pid > > NOTE: Removing the PluginDir directive makes no difference. > > And the Plugin directory contains the accounting/MySQL file: > > ls -al /usr/lib/x86_64-linux-gnu/slurm-wlm/*mysql* > > -rw-r--r-- 1 root root 3145992 Apr 1 2024 /usr/lib/x86_64-linux-gnu/ > slurm-wlm/accounting_storage_mysql.a > > -rw-r--r-- 1 root root 1071 Apr 1 2024 /usr/lib/x86_64-linux-gnu/slurm- > wlm/accounting_storage_mysql.la > > -rw-r--r-- 1 root root 501848 Apr 1 2024 /usr/lib/x86_64-linux-gnu/ > slurm-wlm/accounting_storage_mysql.so > > I checked already the threat on: https://groups.google.com/g/slurm- > users/c/wRV8o7qqGi4 <https://groups.google.com/g/slurm-users/c/wRV8o7qqGi4> > > Any idea what is going on here? > > Regards, > > Karl > > > -- ETH Zurich Stephan Roth Systems Administrator IT Services Group (ISG) D-ITET ETF D 104 Sternwartstrasse 7 8092 Zurich Phone +41 44 632 30 59 stephan.r...@isg.ee.ethz.ch www.isg.ee.ethz.ch Working days: Mon, Tue, Thu, Fri -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
