The issue could also be replicated on another system (512GB SSD, BIOS/legacy boot mode - not UEFI) which was upgraded from Ubuntu 23.04 to Ubuntu 23.10
-- You received this bug notification because you are a member of Kernel Packages, which is subscribed to zfs-linux in Ubuntu. https://bugs.launchpad.net/bugs/2043253 Title: zfs-mount-generator results in ZFS Boot Stuck - Please Give Root Password or Press CTRL+D to Continue Status in zfs-linux package in Ubuntu: New Bug description: System Boot is Abnormal. Gives the message "Give root password for maintenance or press CTRL+D to continue". I installed Ubuntu 23.10 on NVME using debootstrap (UEFI install). I tried to re-generate the zfs cache and that seems to be set correctly in /etc/zfs/zfs-list.cache/rpool. It is possible that the /root, /var/log, /home/ folders contained some data already. I tried to empty them and reboot, to make sure that ZFS would mount correctly. Strangely enough zfs mount -a quickly finishes (without errors) while mount -a seems to enter an infinite loop. The culprit issue seems to be (based on log files): ``` Nov 10 14:00:04 UbuntuWorkstation11 systemd[1]: Reloading requested from client PID 1743 (unit emergency.service)... Nov 10 14:00:04 UbuntuWorkstation11 systemd[1]: Reloading... Nov 10 14:00:04 UbuntuWorkstation11 (sd-execu[1747]: /usr/lib/systemd/system-generators/zfs-mount-generator.orig failed with exit status 1. Nov 10 14:00:04 UbuntuWorkstation11 (sd-execu[1747]: /usr/lib/systemd/system-generators/zfs-mount-generator failed with exit status 1. Nov 10 14:00:04 UbuntuWorkstation11 ERROR: zfs-mount-generator failed and you requested a revert: Nov 10 14:00:04 UbuntuWorkstation11 systemd[1]: Reloading finished in 469 ms. Nov 10 14:00:04 UbuntuWorkstation11 systemd[1]: Reloading requested from client PID 1807 (unit emergency.service)... Nov 10 14:00:04 UbuntuWorkstation11 systemd[1]: Reloading... Nov 10 14:00:04 UbuntuWorkstation11 (sd-execu[1811]: /usr/lib/systemd/system-generators/zfs-mount-generator failed with exit status 1. Nov 10 14:00:04 UbuntuWorkstation11 (sd-execu[1811]: /usr/lib/systemd/system-generators/zfs-mount-generator.orig failed with exit status 1. Nov 10 14:00:04 UbuntuWorkstation11 ERROR: zfs-mount-generator failed and you requested a revert: Nov 10 14:00:05 UbuntuWorkstation11 systemd[1]: Reloading finished in 466 ms. Nov 10 14:00:05 UbuntuWorkstation11 systemd[1]: Reloading requested from client PID 1733 (unit emergency.service)... Nov 10 14:00:05 UbuntuWorkstation11 systemd[1]: Reloading... Nov 10 14:00:05 UbuntuWorkstation11 (sd-execu[1873]: /usr/lib/systemd/system-generators/zfs-mount-generator failed with exit status 1. Nov 10 14:00:05 UbuntuWorkstation11 (sd-execu[1873]: /usr/lib/systemd/system-generators/zfs-mount-generator.orig failed with exit status 1. Nov 10 14:00:05 UbuntuWorkstation11 ERROR: zfs-mount-generator failed and you requested a revert: Nov 10 14:00:05 UbuntuWorkstation11 systemd[1]: Reloading finished in 467 ms. Nov 10 14:00:12 UbuntuWorkstation11 systemd[1]: Stopped target emergency.target - Emergency Mode. ``` It's difficult to know where the issue lies exactly, if the script/program doesn't return more informations on where it's actually failing. ``` root@UbuntuWorkstation11:/# zfs list NAME USED AVAIL REFER MOUNTPOINT rpool 7.30G 1.75T 96K none rpool/ROOT 7.29G 1.75T 96K none rpool/ROOT/ubuntu 7.29G 1.75T 6.81G / rpool/ROOT/ubuntu/srv 96K 1.75T 96K /srv rpool/ROOT/ubuntu/tmp 408K 1.75T 136K /tmp rpool/ROOT/ubuntu/usr 424K 1.75T 96K /usr rpool/ROOT/ubuntu/usr/local 328K 1.75T 192K /usr/local rpool/ROOT/ubuntu/var 262M 1.75T 96K /var rpool/ROOT/ubuntu/var/games 96K 1.75T 96K /var/games rpool/ROOT/ubuntu/var/lib 259M 1.75T 56.4M /var/lib rpool/ROOT/ubuntu/var/lib/AccountsService 224K 1.75T 96K /var/lib/AccountsService rpool/ROOT/ubuntu/var/lib/NetworkManager 236K 1.75T 116K /var/lib/NetworkManager rpool/ROOT/ubuntu/var/lib/apt 123M 1.75T 122M /var/lib/apt rpool/ROOT/ubuntu/var/lib/dpkg 77.9M 1.75T 65.7M /var/lib/dpkg rpool/ROOT/ubuntu/var/log 1.64M 1.75T 236K /var/log rpool/ROOT/ubuntu/var/mail 96K 1.75T 96K /var/mail rpool/ROOT/ubuntu/var/spool 264K 1.75T 144K /var/spool rpool/ROOT/ubuntu/var/www 96K 1.75T 96K /var/www rpool/USERDATA 524K 1.75T 96K none rpool/USERDATA/root 276K 1.75T 140K /root rpool/USERDATA/stefano 152K 1.75T 96K /home/stefano ``` The mounting order to /root, /home/stefano and /var/tmp is suspicious. And I have a feeling that ZFS keeps trying to automount since e.g. the journalctl log file that I created in /root/ quickly disappeared after creation. ``` root@UbuntuWorkstation11:/# cat /etc/fstab # /boot Partition UUID=8ce455bf-bc4e-4fe4-8a53-c488af3bb89c /boot ext4 auto 0 1 # /boot/efi Data UUID=C39A-FFBB /boot/efi vfat umask=0022,fmask=0022,dmask=0022 0 1 # Tools over NFS nas.home:/export/tools /tools_nfs nfs rw,user=tools,auto,nfsvers=3 0 0 ``` Tried ZFS 2.2.0 ("final") from mantic-proposed repository, but same issue happens. It seems zfs-mount-generator causes the boot process to fail, thus systemd requests Root Password or CTRL+D to continue. ``` root@UbuntuWorkstation02:/# zfs version zfs-2.2.0-0ubuntu1~23.10 zfs-kmod-2.2.0-0ubuntu1~23.10 ``` The bug is also reported upstream, however it's very likely to be Ubuntu-specific, since no other person complained about it. Upstream bug report: https://github.com/openzfs/zfs/issues/15512 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/2043253/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
