Hi Henning, On Tue, 2024-12-17 at 14:13:00 +0100, Henning Glawe wrote: > Moin, > > are you booting via BIOS/legacy or UEFI (with the corresponding GRUB)?
UEFI, with the right GRUB. It's not the first time I'm doing this, and it works without the JBODs connected. I haven't even found a LEGACY setting in the BIOS of this AMD Genoa machine. > "out of memory" sounds like something more likely to hit in a BIOS/legacy > boot. I'm seeing some unlikely error then... - S > > > On Tue, Dec 17, 2024 at 10:07:56AM +0100, Steffen Grunewald wrote: > > Good morning, > > > > after a very promising start, I experienced a set-back yesterday with an > > otherwise proven-to-work FAI setup, and need an alternative now. > > > > Over the past years, I wrote, used, and improved, a scheme that would > > ignore disk_config completely and work with hooks, to create a ZFS root > > pool (and possibly a data pool as well) over disks selected via patterns > > (usually /dev/disk/by-id/ata-MANUFACTURER). > > > > This initially also worked for my recent setup, a BeeGFS server with two > > OS disks (ata-*), a handful NVMes and two times 60 disks over multipath, > > in total 247 disks seen by the kernel. > > > > After setting up multipath and storage zpools, I can no longer boot into > > the system as long as at least one JBOD is connected - grub 2.06 gets an > > "error: out of memory" and even refuses such elementary tasks as > > "ls (...)/". > > Upgrading to grub 2.12 (from bookworm-backports) makes things worse as > > the screen stays dark, not even the greeting "Welcome to GRUB!" comes up. > > > > I'm afraid I've got to go back to md raid, but with all disks connected, > > how do I find the two system disks, if not via /dev/disk/by-id? (a quick > > check with "sysinfo" shows them at /dev/sda and /dev/sddi) > > > > Is there a regular way via disk_config, or do I have to invent a 17-sided > > wheel myself? > > > > Thanks for listening, > > S > > > > -- > > Steffen Grunewald, Cluster Administrator > > Max Planck Institute for Gravitational Physics (Albert Einstein Institute) > > Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany > > ~~~ > > Fon: +49-331-567 7274 > > Mail: steffen.grunewald(at)aei.mpg.de > > ~~~ > > -- > Mit freundlichen Grüßen > Henning Glawe > > Dr. Henning Glawe > Max-Planck-Institut für Struktur und Dynamik der Materie > Geb. 900 (MPSD), Luruper Chaussee 149, 22761 Hamburg, Germany > http://www.mpsd.mpg.de/, Email: henning.gl...@mpsd.mpg.de > Building/Room: 900/O1.053, Phone: +49-40-8998-88392 -- Steffen Grunewald, Cluster Administrator Max Planck Institute for Gravitational Physics (Albert Einstein Institute) Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany ~~~ Fon: +49-331-567 7274 Mail: steffen.grunewald(at)aei.mpg.de ~~~
