So, I was running my full backup last night, backing up my main data
pool zp1, and it seems to have hung.
Any suggestions for additional data gathering?
-bash-3.2$ zpool status zp1
pool: zp1
state: ONLINE
status: The pool is formatted using an older on-disk format. The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'. Once this is done, the
pool will no longer be accessible on older software versions.
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
zp1 ONLINE 0 0 0
mirror ONLINE 0 0 0
c5t0d0 ONLINE 0 0 0
c5t1d0 ONLINE 0 0 0
mirror ONLINE 0 0 0
c6t0d0 ONLINE 0 0 0
c6t1d0 ONLINE 0 0 0
errors: No known data errors
to one of my external USB drives holding pool bup-wrack
-bash-3.2$ zpool status bup-wrack
pool: bup-wrack
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
bup-wrack ONLINE 0 0 0
c7t0d0 ONLINE 0 0 0
errors: No known data errors
The line in the script that starts the send and receive is
zfs send -Rv "$srcsnap" | zfs recv -Fudv "$BUPPOOL/$HOSTNAME/$FS"
And the -v causes the start and stop of each incremental stream to be
announced of course. The last output from it was:
sending from @bup-20090315-190807UTC to zp1/d...@bup-20090424-034702utc
receiving incremental stream of zp1/d...@bup-20090424-034702utc into
bup-wrack/fsfs/zp1/d...@bup-20090424-034702utc
And it appears hung when I got up this morning. No activity on the
drive, zpool iostat shows no activity on the backup pool and no
unexplained activity on the data pool. The server is responsive, and
the data pool is responsive. ps shows considerable accumulated time on
the backup and receive processes, but no change in the last half hour.
zpool list shows that quite a lot of data has not yet been transferred
to the backup pool (which was newly-created when this backup started).
-bash-3.2$ zpool list
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
bup-wrack 928G 438G 490G 47% ONLINE /backups/bup-wrack
rpool 74G 6.35G 67.7G 8% ONLINE -
zp1 744G 628G 116G 84% ONLINE -
ps -ef shows
root 3153 3145 0 23:09:07 pts/3 19:59 zfs recv -Fudv
bup-wrack/fsfs/zp1
root 3145 3130 0 23:09:04 pts/3 0:00 /bin/bash
./bup-backup-full zp1 bup-wrack
root 3152 3145 0 23:09:07 pts/3 17:06 zfs send -Rv
z...@bup-20100208-050907gmt
zfs list shows:
-bash-3.2$ zfs list -t snapshot,filesystem -r zp1
NAME USED AVAIL REFER MOUNTPOINT
zp1 628G 104G 33.8M /home
z...@bup-20090223-033745utc 0 - 33.8M -
z...@bup-20090225-184857utc 0 - 33.8M -
z...@bup-20090302-032437utc 0 - 33.8M -
z...@bup-20090309-033514utc 0 - 33.8M -
z...@bup-20090315-190807utc 0 - 33.8M -
z...@bup-20090424-034702utc 22K - 33.8M -
z...@bup-20090619-063536gmt 0 - 33.8M -
z...@bup-20090619-143851utc 0 - 33.8M -
z...@bup-20090804-024506utc 0 - 33.8M -
z...@bup-20090906-192431utc 0 - 33.8M -
z...@bup-20100102-035216utc 0 - 33.8M -
z...@bup-20100102-184101utc 0 - 33.8M -
z...@bup-20100208-050707gmt 0 - 33.8M -
z...@bup-20100208-050907gmt 0 - 33.8M -
zp1/ddb 494G 104G 452G /home/ddb
zp1/d...@bup-20090223-033745utc 5.12M - 326G -
zp1/d...@bup-20090225-184857utc 4.15M - 328G -
zp1/d...@bup-20090302-032437utc 16.6M - 329G -
zp1/d...@bup-20090309-033514utc 8.95M - 330G -
zp1/d...@bup-20090315-190807utc 35.3M - 330G -
zp1/d...@bup-20090424-034702utc 140M - 345G -
zp1/d...@bup-20090619-063536gmt 43.9M - 386G -
zp1/d...@bup-20090619-143851utc 44.9M - 386G -
zp1/d...@bup-20090804-024506utc 4.30G - 418G -
zp1/d...@bup-20090906-192431utc 8.43G - 440G -
zp1/d...@bup-20100102-035216utc 4.13G - 435G -
zp1/d...@bup-20100102-184101utc 108M - 431G -
zp1/d...@bup-20100208-050707gmt 142K - 452G -
zp1/d...@bup-20100208-050907gmt 140K - 452G -
zp1/jmf 33.5G 104G 33.3G /home/jmf
zp1/j...@bup-20090223-033745utc 0 - 33.2G -
zp1/j...@bup-20090225-184857utc 0 - 33.2G -
zp1/j...@bup-20090302-032437utc 0 - 33.2G -
zp1/j...@bup-20090309-033514utc 0 - 33.2G -
zp1/j...@bup-20090315-190807utc 0 - 33.2G -
zp1/j...@bup-20090424-034702utc 0 - 33.3G -
zp1/j...@bup-20090619-063536gmt 0 - 33.3G -
zp1/j...@bup-20090619-143851utc 0 - 33.3G -
zp1/j...@bup-20090804-024506utc 0 - 33.3G -
zp1/j...@bup-20090906-192431utc 42K - 33.3G -
zp1/j...@bup-20100102-035216utc 0 - 33.3G -
zp1/j...@bup-20100102-184101utc 0 - 33.3G -
zp1/j...@bup-20100208-050707gmt 0 - 33.3G -
zp1/j...@bup-20100208-050907gmt 0 - 33.3G -
zp1/lydy 31.1G 104G 31.1G /home/lydy
zp1/l...@bup-20090223-033745utc 0 - 31.1G -
zp1/l...@bup-20090225-184857utc 0 - 31.1G -
zp1/l...@bup-20090302-032437utc 0 - 31.1G -
zp1/l...@bup-20090309-033514utc 0 - 31.1G -
zp1/l...@bup-20090315-190807utc 0 - 31.1G -
zp1/l...@bup-20090424-034702utc 0 - 31.1G -
zp1/l...@bup-20090619-063536gmt 0 - 31.1G -
zp1/l...@bup-20090619-143851utc 0 - 31.1G -
zp1/l...@bup-20090804-024506utc 0 - 31.1G -
zp1/l...@bup-20090906-192431utc 0 - 31.1G -
zp1/l...@bup-20100102-035216utc 0 - 31.1G -
zp1/l...@bup-20100102-184101utc 0 - 31.1G -
zp1/l...@bup-20100208-050707gmt 0 - 31.1G -
zp1/l...@bup-20100208-050907gmt 0 - 31.1G -
zp1/music 24.8G 104G 24.8G /home/music
zp1/mu...@bup-20090223-033745utc 1.03M - 24.3G -
zp1/mu...@bup-20090225-184857utc 619K - 24.3G -
zp1/mu...@bup-20090302-032437utc 287K - 24.3G -
zp1/mu...@bup-20090309-033514utc 0 - 24.3G -
zp1/mu...@bup-20090315-190807utc 0 - 24.3G -
zp1/mu...@bup-20090424-034702utc 1.38M - 24.3G -
zp1/mu...@bup-20090619-063536gmt 0 - 24.3G -
zp1/mu...@bup-20090619-143851utc 0 - 24.3G -
zp1/mu...@bup-20090804-024506utc 2.08M - 24.8G -
zp1/mu...@bup-20090906-192431utc 2.04M - 24.8G -
zp1/mu...@bup-20100102-035216utc 906K - 24.8G -
zp1/mu...@bup-20100102-184101utc 932K - 24.8G -
zp1/mu...@bup-20100208-050707gmt 0 - 24.8G -
zp1/mu...@bup-20100208-050907gmt 0 - 24.8G -
zp1/pddb 2.05G 104G 2.05G /home/pddb
zp1/p...@bup-20090223-033745utc 0 - 2.05G -
zp1/p...@bup-20090225-184857utc 0 - 2.05G -
zp1/p...@bup-20090302-032437utc 0 - 2.05G -
zp1/p...@bup-20090309-033514utc 0 - 2.05G -
zp1/p...@bup-20090315-190807utc 0 - 2.05G -
zp1/p...@bup-20090424-034702utc 0 - 2.05G -
zp1/p...@bup-20090619-063536gmt 0 - 2.05G -
zp1/p...@bup-20090619-143851utc 0 - 2.05G -
zp1/p...@bup-20090804-024506utc 0 - 2.05G -
zp1/p...@bup-20090906-192431utc 0 - 2.05G -
zp1/p...@bup-20100102-035216utc 0 - 2.05G -
zp1/p...@bup-20100102-184101utc 0 - 2.05G -
zp1/p...@bup-20100208-050707gmt 0 - 2.05G -
zp1/p...@bup-20100208-050907gmt 0 - 2.05G -
zp1/public 43.1G 104G 33.7G /home/public
zp1/pub...@bup-20090223-033745utc 191K - 33.8G -
zp1/pub...@bup-20090225-184857utc 58K - 33.8G -
zp1/pub...@bup-20090302-032437utc 59K - 33.8G -
zp1/pub...@bup-20090309-033514utc 104K - 33.9G -
zp1/pub...@bup-20090315-190807utc 335K - 33.9G -
zp1/pub...@bup-20090424-034702utc 29.0M - 26.1G -
zp1/pub...@bup-20090619-063536gmt 234K - 26.6G -
zp1/pub...@bup-20090619-143851utc 235K - 26.6G -
zp1/pub...@bup-20090804-024506utc 943K - 27.1G -
zp1/pub...@bup-20090906-192431utc 8.97M - 27.3G -
zp1/pub...@bup-20100102-035216utc 1.67M - 33.5G -
zp1/pub...@bup-20100102-184101utc 1.66M - 33.5G -
zp1/pub...@bup-20100208-050707gmt 0 - 33.7G -
zp1/pub...@bup-20100208-050907gmt 0 - 33.7G -
zp1/raphael 69K 104G 20K /home/raphael
zp1/raph...@bup-20090223-033745utc 0 - 18K -
zp1/raph...@bup-20090225-184857utc 0 - 18K -
zp1/raph...@bup-20090302-032437utc 0 - 18K -
zp1/raph...@bup-20090309-033514utc 0 - 18K -
zp1/raph...@bup-20090315-190807utc 0 - 18K -
zp1/raph...@bup-20090424-034702utc 0 - 18K -
zp1/raph...@bup-20090619-063536gmt 0 - 18K -
zp1/raph...@bup-20090619-143851utc 0 - 18K -
zp1/raph...@bup-20090804-024506utc 0 - 18K -
zp1/raph...@bup-20090906-192431utc 0 - 18K -
zp1/raph...@bup-20100102-035216utc 0 - 20K -
zp1/raph...@bup-20100102-184101utc 0 - 20K -
zp1/raph...@bup-20100208-050707gmt 0 - 20K -
zp1/raph...@bup-20100208-050907gmt 0 - 20K -
--
David Dyer-Bennet, d...@dd-b.net; http://dd-b.net/
Snapshots: http://dd-b.net/dd-b/SnapshotAlbum/data/
Photos: http://dd-b.net/photography/gallery/
Dragaera: http://dragaera.info
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
