On Wed, May 11, 2022 at 03:03:54PM -0300, Antonio Terceiro wrote: > On Fri, May 06, 2022 at 07:08:23PM +0100, Julian Gilbey wrote: > [...] > > I've no idea if that is of any help. > > I could not find anything wrong in those. I'm sorry but I don't know > what's wrong with your system. can you debug to check what is the exact > point where it fails to start a container?
Thanks Antonio! Here's a log file with logpriority at DEBUG; I've no idea if this will help. I'm so stumped. I wondered if it was perhaps some extra kernel modules (using dkms) causing the problem, so I've purged those and rebooted, but it didn't help. Something seems to be confused with the cgroups. Here's the result of mount | grep cgroup: cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime) none on /sys/fs/cgroup/net_cls type cgroup (rw,relatime,net_cls) And ls /sys/fs/cgroup gives: cgroup.controllers dev-hugepages.mount misc.capacity cgroup.max.depth dev-mqueue.mount net_cls cgroup.max.descendants init.scope proc-fs-nfsd.mount cgroup.procs io.cost.model proc-sys-fs-binfmt_misc.mount cgroup.stat io.cost.qos sys-fs-fuse-connections.mount cgroup.subtree_control io.pressure sys-kernel-config.mount cgroup.threads io.stat sys-kernel-debug.mount cpu.pressure lxc.pivot sys-kernel-tracing.mount cpuset.cpus.effective memory.numa_stat system.slice cpuset.mems.effective memory.pressure user.slice cpu.stat memory.stat Ho hum :-/ Julian lxc-start debian-unstable-trial 20220511204109.279 INFO lxccontainer - lxccontainer.c:do_lxcapi_start:987 - Set process title to [lxc monitor] /var/lib/lxc debian-unstable-trial lxc-start debian-unstable-trial 20220511204109.280 DEBUG lxccontainer - lxccontainer.c:wait_on_daemonized_start:848 - First child 502040 exited lxc-start debian-unstable-trial 20220511204109.280 INFO lsm - lsm/lsm.c:lsm_init_static:38 - Initialized LSM security driver AppArmor lxc-start debian-unstable-trial 20220511204109.281 DEBUG seccomp - seccomp.c:parse_config_v2:656 - Host native arch is [3221225534] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "reject_force_umount # comment this to allow umount -f; not recommended" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:524 - Set seccomp rule to reject force umounts lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:524 - Set seccomp rule to reject force umounts lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:524 - Set seccomp rule to reject force umounts lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "[all]" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "kexec_load errno 1" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding native rule for syscall[246:kexec_load] action[327681:errno] arch[0] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[246:kexec_load] action[327681:errno] arch[1073741827] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[246:kexec_load] action[327681:errno] arch[1073741886] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "open_by_handle_at errno 1" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding native rule for syscall[304:open_by_handle_at] action[327681:errno] arch[0] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[304:open_by_handle_at] action[327681:errno] arch[1073741827] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[304:open_by_handle_at] action[327681:errno] arch[1073741886] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "init_module errno 1" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding native rule for syscall[175:init_module] action[327681:errno] arch[0] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[175:init_module] action[327681:errno] arch[1073741827] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[175:init_module] action[327681:errno] arch[1073741886] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "finit_module errno 1" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding native rule for syscall[313:finit_module] action[327681:errno] arch[0] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[313:finit_module] action[327681:errno] arch[1073741827] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[313:finit_module] action[327681:errno] arch[1073741886] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:807 - Processing "delete_module errno 1" lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding native rule for syscall[176:delete_module] action[327681:errno] arch[0] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[176:delete_module] action[327681:errno] arch[1073741827] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:do_resolve_add_rule:564 - Adding compat rule for syscall[176:delete_module] action[327681:errno] arch[1073741886] lxc-start debian-unstable-trial 20220511204109.281 INFO seccomp - seccomp.c:parse_config_v2:1017 - Merging compat seccomp contexts into main context lxc-start debian-unstable-trial 20220511204109.511 INFO start - start.c:lxc_init:883 - Container "debian-unstable-trial" is initialized lxc-start debian-unstable-trial 20220511204109.531 INFO cgfsng - cgroups/cgfsng.c:cgfsng_monitor_create:1028 - The monitor process uses "lxc.monitor.debian-unstable-trial" as cgroup lxc-start debian-unstable-trial 20220511204109.531 DEBUG storage - storage/storage.c:get_storage_by_name:209 - Detected rootfs type "dir" lxc-start debian-unstable-trial 20220511204109.532 INFO cgfsng - cgroups/cgfsng.c:cgfsng_payload_create:1136 - The container process uses "lxc.payload.debian-unstable-trial" as inner and "lxc.payload.debian-unstable-trial" as limit cgroup lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:lxc_spawn:1759 - Cloned CLONE_NEWNS lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:lxc_spawn:1759 - Cloned CLONE_NEWPID lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:lxc_spawn:1759 - Cloned CLONE_NEWUTS lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:lxc_spawn:1759 - Cloned CLONE_NEWIPC lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:lxc_spawn:1759 - Cloned CLONE_NEWNET lxc-start debian-unstable-trial 20220511204109.534 DEBUG start - start.c:lxc_try_preserve_namespace:139 - Preserved mnt namespace via fd 21 and stashed path as mnt:/proc/502041/fd/21 lxc-start debian-unstable-trial 20220511204109.534 DEBUG start - start.c:lxc_try_preserve_namespace:139 - Preserved pid namespace via fd 22 and stashed path as pid:/proc/502041/fd/22 lxc-start debian-unstable-trial 20220511204109.534 DEBUG start - start.c:lxc_try_preserve_namespace:139 - Preserved uts namespace via fd 23 and stashed path as uts:/proc/502041/fd/23 lxc-start debian-unstable-trial 20220511204109.534 DEBUG start - start.c:lxc_try_preserve_namespace:139 - Preserved ipc namespace via fd 24 and stashed path as ipc:/proc/502041/fd/24 lxc-start debian-unstable-trial 20220511204109.534 DEBUG start - start.c:lxc_try_preserve_namespace:139 - Preserved net namespace via fd 25 and stashed path as net:/proc/502041/fd/25 lxc-start debian-unstable-trial 20220511204109.534 INFO cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2749 - Limits for the legacy cgroup hierarchies have been setup lxc-start debian-unstable-trial 20220511204109.534 WARN cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2809 - Invalid argument - Ignoring cgroup2 limits on legacy cgroup system lxc-start debian-unstable-trial 20220511204109.534 INFO start - start.c:do_start:1206 - Unshared CLONE_NEWCGROUP lxc-start debian-unstable-trial 20220511204109.542 INFO network - network.c:netdev_configure_server_veth:655 - Retrieved mtu 1500 from lxcbr0 lxc-start debian-unstable-trial 20220511204109.557 INFO network - network.c:netdev_configure_server_veth:720 - Attached "vethS9TtPh" to bridge "lxcbr0" lxc-start debian-unstable-trial 20220511204109.557 DEBUG network - network.c:netdev_configure_server_veth:851 - Instantiated veth tunnel "vethS9TtPh <--> vethVbX9aI" lxc-start debian-unstable-trial 20220511204109.558 DEBUG conf - conf.c:lxc_mount_rootfs:1423 - Mounted rootfs "/var/lib/lxc/debian-unstable-trial/rootfs" onto "/usr/lib/x86_64-linux-gnu/lxc/rootfs" with options "(null)" lxc-start debian-unstable-trial 20220511204109.558 INFO conf - conf.c:setup_utsname:866 - Set hostname to "debian-unstable-trial" lxc-start debian-unstable-trial 20220511204109.558 INFO network - network.c:lxc_setup_network_in_child_namespaces:4005 - Finished setting up network devices with caller assigned names lxc-start debian-unstable-trial 20220511204109.583 DEBUG network - network.c:setup_hw_addr:3807 - Mac address "00:16:3e:98:ce:14" on "eth0" has been setup lxc-start debian-unstable-trial 20220511204109.583 DEBUG network - network.c:lxc_network_setup_in_child_namespaces_common:3948 - Network device "eth0" has been setup lxc-start debian-unstable-trial 20220511204109.583 INFO network - network.c:lxc_setup_network_in_child_namespaces:4021 - Finished setting up network devices with kernel assigned names lxc-start debian-unstable-trial 20220511204109.583 INFO conf - conf.c:mount_autodev:1206 - Preparing "/dev" lxc-start debian-unstable-trial 20220511204109.583 INFO conf - conf.c:mount_autodev:1267 - Prepared "/dev" lxc-start debian-unstable-trial 20220511204109.583 DEBUG conf - conf.c:lxc_mount_auto_mounts:733 - Invalid argument - Tried to ensure procfs is unmounted lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:lxc_mount_auto_mounts:756 - Invalid argument - Tried to ensure sysfs is unmounted lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:mount_entry:2403 - Remounting "/sys/fs/fuse/connections" on "/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections" to respect bind or remount options lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:mount_entry:2422 - Flags for "/sys/fs/fuse/connections" were 4110, required extra flags are 14 lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:mount_entry:2466 - Mounted "/sys/fs/fuse/connections" on "/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections" with filesystem type "none" lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:mount_entry:2466 - Mounted "proc" on "/usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/.lxc/proc" with filesystem type "proc" lxc-start debian-unstable-trial 20220511204109.584 DEBUG conf - conf.c:mount_entry:2466 - Mounted "sys" on "/usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/.lxc/sys" with filesystem type "sysfs" lxc-start debian-unstable-trial 20220511204109.584 INFO conf - conf.c:run_script_argv:337 - Executing script "/usr/share/lxcfs/lxc.mount.hook" for container "debian-unstable-trial", config section "lxc" lxc-start debian-unstable-trial 20220511204109.652 INFO conf - conf.c:lxc_fill_autodev:1304 - Populating "/dev" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "full" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "null" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "random" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "tty" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "urandom" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_fill_autodev:1313 - Created device node "zero" lxc-start debian-unstable-trial 20220511204109.652 INFO conf - conf.c:lxc_fill_autodev:1392 - Populated "/dev" lxc-start debian-unstable-trial 20220511204109.652 INFO conf - conf.c:lxc_transient_proc:3757 - Caller's PID is 1; /proc/self points to 1 lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_devpts_child:1738 - Attached detached devpts mount 24 to 22/pts lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_devpts_child:1824 - Created "/dev/ptmx" file as bind mount target lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_devpts_child:1831 - Bind mounted "/dev/pts/ptmx" to "/dev/ptmx" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_allocate_ttys:1092 - Created tty with ptx fd 26 and pty fd 27 and index 1 lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_allocate_ttys:1092 - Created tty with ptx fd 28 and pty fd 29 and index 2 lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_allocate_ttys:1092 - Created tty with ptx fd 30 and pty fd 31 and index 3 lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_allocate_ttys:1092 - Created tty with ptx fd 32 and pty fd 33 and index 4 lxc-start debian-unstable-trial 20220511204109.652 INFO conf - conf.c:lxc_allocate_ttys:1097 - Finished creating 4 tty devices lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_ttys:1056 - Bind mounted "" onto "tty1" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_ttys:1056 - Bind mounted "" onto "tty2" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_ttys:1056 - Bind mounted "" onto "tty3" lxc-start debian-unstable-trial 20220511204109.652 DEBUG conf - conf.c:lxc_setup_ttys:1056 - Bind mounted "" onto "tty4" lxc-start debian-unstable-trial 20220511204109.653 INFO conf - conf.c:lxc_setup_ttys:1063 - Finished setting up 4 /dev/tty<N> device(s) lxc-start debian-unstable-trial 20220511204109.654 INFO conf - conf.c:setup_personality:1904 - Set personality to "0lx0" lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3187 - Dropped mac_admin (33) capability lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3187 - Dropped mac_override (32) capability lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3187 - Dropped sys_time (25) capability lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3187 - Dropped sys_module (16) capability lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3187 - Dropped sys_rawio (17) capability lxc-start debian-unstable-trial 20220511204109.654 DEBUG conf - conf.c:capabilities_deny:3190 - Capabilities have been setup lxc-start debian-unstable-trial 20220511204109.654 NOTICE conf - conf.c:lxc_setup:4450 - The container "debian-unstable-trial" is set up lxc-start debian-unstable-trial 20220511204109.654 INFO apparmor - lsm/apparmor.c:apparmor_process_label_set_at:1186 - Set AppArmor label to "lxc-debian-unstable-trial_</var/lib/lxc>//&:lxc-debian-unstable-trial_<-var-lib-lxc>:" lxc-start debian-unstable-trial 20220511204109.654 INFO apparmor - lsm/apparmor.c:apparmor_process_label_set:1231 - Changed AppArmor profile to lxc-debian-unstable-trial_</var/lib/lxc>//&:lxc-debian-unstable-trial_<-var-lib-lxc>: lxc-start debian-unstable-trial 20220511204109.655 WARN cgfsng - cgroups/cgfsng.c:get_hierarchy:142 - There is no useable devices controller lxc-start debian-unstable-trial 20220511204109.655 ERROR cgfsng - cgroups/cgfsng.c:cg_legacy_set_data:2675 - No such file or directory - Failed to setup limits for the "devices" controller. The controller seems to be unused by "cgfsng" cgroup driver or not enabled on the cgroup hierarchy lxc-start debian-unstable-trial 20220511204109.655 ERROR cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2742 - No such file or directory - Failed to set "devices.deny" to "a" lxc-start debian-unstable-trial 20220511204109.655 ERROR start - start.c:lxc_spawn:1890 - Failed to setup legacy device cgroup controller limits lxc-start debian-unstable-trial 20220511204109.655 DEBUG network - network.c:lxc_delete_network:4159 - Deleted network devices lxc-start debian-unstable-trial 20220511204109.655 ERROR lxccontainer - lxccontainer.c:wait_on_daemonized_start:867 - Received container state "ABORTING" instead of "RUNNING" lxc-start debian-unstable-trial 20220511204109.655 ERROR lxc_start - tools/lxc_start.c:main:306 - The container failed to start lxc-start debian-unstable-trial 20220511204109.655 ERROR lxc_start - tools/lxc_start.c:main:309 - To get more details, run the container in foreground mode lxc-start debian-unstable-trial 20220511204109.655 ERROR lxc_start - tools/lxc_start.c:main:311 - Additional information can be obtained by setting the --logfile and --logpriority options lxc-start debian-unstable-trial 20220511204109.655 ERROR start - start.c:__lxc_start:2068 - Failed to spawn container "debian-unstable-trial" lxc-start debian-unstable-trial 20220511204109.655 WARN start - start.c:lxc_abort:1038 - No such process - Failed to send SIGKILL via pidfd 20 for process 502047 lxc-start debian-unstable-trial 20220511204109.900 INFO conf - conf.c:run_script_argv:337 - Executing script "/usr/share/lxcfs/lxc.reboot.hook" for container "debian-unstable-trial", config section "lxc"
