Rainer Orth <[EMAIL PROTECTED]> writes: > Yesterday evening, I tried Live Upgrade on a Sun Fire V60x running SX:CE 90 > to SX:CE 93 with ZFS root (mirrored root pool called root). The LU itself > ran without problems, but before rebooting the machine, I wanted to add > some space to the root pool that had previously been in use for an UFS BE. > > Both disks (c0t0d0 and c0t1d0) were partitioned as follows: > > Part Tag Flag Cylinders Size Blocks > 0 root wm 1 - 18810 25.91GB (18810/0/0) 54342090 > 1 unassigned wm 18811 - 24618 8.00GB (5808/0/0) 16779312 > 2 backup wm 0 - 24618 33.91GB (24619/0/0) 71124291 > 3 unassigned wu 0 0 (0/0/0) 0 > 4 unassigned wu 0 0 (0/0/0) 0 > 5 unassigned wu 0 0 (0/0/0) 0 > 6 unassigned wu 0 0 (0/0/0) 0 > 7 unassigned wu 0 0 (0/0/0) 0 > 8 boot wu 0 - 0 1.41MB (1/0/0) 2889 > 9 unassigned wu 0 0 (0/0/0) 0 > > Slice 0 is used by the root pool, slice 1 was used by the UFS BE. To > achieve this, I ludeleted the now unused UFS BE and used > > # NOINUSE_CHECK=1 format > > to extend slice 0 by the size of slice 1, deleting the latter afterwards. > I'm pretty sure that I've done this successfully before, even on a live > system, but this time something went wrong: I remember an FMA message about > one side of the root pool mirror being broken (something about an > inconsistent label, unfortunately I didn't write down the exact message). > Nonetheless, I rebooted the machine after luactivate sol_nv_93 (the new ZFS > BE), but the machine didn't come up: > > SunOS Release 5.11 Version snv_93 32-bit > Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved. > Use is subject to license terms. > NOTICE: > spa_import_rootpool: error 22 > > > panic[cpu0]/thread=fec1cfe0: cannot mount root path /[EMAIL > PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL PROTECTED],0:a /[EMAIL > PROTECTED],0/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL PROTECTED],0:a > > fec351ac genunix:rootconf+10b (c0f040, 1, fec1c750) > fec351d0 genunix:vfs_mountroot+54 (fe800010, fec30fd8,) > fec351e4 genunix:main+b4 () > > panic: entering debugger (no dump device, continue to reboot) > skipping system dump - no dump device configured > rebooting... > > I've managed a failsafe boot (from the same pool), and zpool import reveals > > pool: root > id: 14475053522795106129 > state: UNAVAIL > status: The pool was last accessed by another system. > action: The pool cannot be imported due to damaged devices or data. > see: http://www.sun.com/msg/ZFS-8000-EY > config: > > root UNAVAIL insufficient replicas > mirror UNAVAIL corrupted data > c0t1d0s0 ONLINE > c0t0d0s0 ONLINE > > Even restoring slice 1 on both disks to its old size and shrinking slice 0 > accordingly doesn't help. I'm sure I've done this correctly since I could > boot from the old sol_nv_b90_ufs BE, which was still on c0t0d0s1. > > I didn't have much success to find out what's going on here: I tried to > remove either of the disks in case both sides of the mirror are > inconsistent, but to no avail. I didn't have much luck with zdb either. > Here's the output of zdb -l /dev/rdsk/c0t0d0s0 and /dev/rdsk/c0t1d0s0: > > c0t0d0s0: > > -------------------------------------------- > LABEL 0 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643945 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=6121143629633742955 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=36409180160 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 1 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643945 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=6121143629633742955 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=36409180160 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 2 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14549625 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='' > top_guid=17627503873514720747 > guid=6121143629633742955 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=27818196992 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 3 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14549625 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='' > top_guid=17627503873514720747 > guid=6121143629633742955 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=27818196992 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > > c0t1d0s0: > > -------------------------------------------- > LABEL 0 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643905 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=36409180160 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 1 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643905 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=36409180160 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 2 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643900 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=27818196992 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > -------------------------------------------- > LABEL 3 > -------------------------------------------- > version=10 > name='root' > state=0 > txg=14643900 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > guid=17627503873514720747 > whole_disk=0 > metaslab_array=13 > metaslab_shift=28 > ashift=9 > asize=27818196992 > is_log=0 > children[0] > type='disk' > id=0 > guid=1526746004928780410 > path='/dev/dsk/c0t1d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=160 > children[1] > type='disk' > id=1 > guid=6121143629633742955 > path='/dev/dsk/c0t0d0s0' > devid='id1,[EMAIL PROTECTED]/a' > phys_path='/[EMAIL PROTECTED],0/pci8086,[EMAIL > PROTECTED]/pci8086,[EMAIL PROTECTED]/pci8086,[EMAIL PROTECTED],1/[EMAIL > PROTECTED],0:a' > whole_disk=0 > DTL=272 > > A diff between both files shows: > > --- c0t0d0s0.zdb-l Fri Jul 11 17:50:07 2008 > +++ c0t1d0s0.zdb-l Fri Jul 11 17:50:08 2008 > @@ -4,12 +4,12 @@ > version=10 > name='root' > state=0 > - txg=14643945 > + txg=14643905 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > - guid=6121143629633742955 > + guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > @@ -44,12 +44,12 @@ > version=10 > name='root' > state=0 > - txg=14643945 > + txg=14643905 > pool_guid=14475053522795106129 > hostid=336880771 > hostname='erebus' > top_guid=17627503873514720747 > - guid=6121143629633742955 > + guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > @@ -84,12 +84,12 @@ > version=10 > name='root' > state=0 > - txg=14549625 > + txg=14643900 > pool_guid=14475053522795106129 > hostid=336880771 > - hostname='' > + hostname='erebus' > top_guid=17627503873514720747 > - guid=6121143629633742955 > + guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > @@ -124,12 +124,12 @@ > version=10 > name='root' > state=0 > - txg=14549625 > + txg=14643900 > pool_guid=14475053522795106129 > hostid=336880771 > - hostname='' > + hostname='erebus' > top_guid=17627503873514720747 > - guid=6121143629633742955 > + guid=1526746004928780410 > vdev_tree > type='mirror' > id=0 > > Other invocations of zdb didn't have much success, unfortunately: > > # zdb -u -e root > zdb: More than one matching pool - specify guid/devid/device path. > # zdb -u -e /dev/rdsk/c0t0d0s0 > zdb: can't open /dev/rdsk/c0t0d0s0: No such file or directory > # zdb -u -e 14475053522795106129 > zdb: can't open 14475053522795106129: Invalid argument > > I have no idea why device path or guid (from zpool import) don't work > here. > > Is there any chance to recover the pool contents (which of course contains > other data besides the O/S installation), or a least to understand why this > resize exercise went terribly wrong here?
Unfortunately, I've received no comment whatsoever on this issue. I don't think growing slices underlying a mirrored root pool should so badly corrupt the pool. I may file a CR if this thread gives no result. Rainer -- ----------------------------------------------------------------------------- Rainer Orth, Faculty of Technology, Bielefeld University _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss