Second crash actually matches bug id 6618522 On Sun, Mar 23, 2008 at 1:28 AM, Asif Iqbal <[EMAIL PROTECTED]> wrote: > First crash seems to match BUG ID 6439484 > Second crash seems to match BUG ID 6523336 > > I see both of them are closed without any recommendation. > > > > On Sun, Mar 23, 2008 at 1:22 AM, Asif Iqbal <[EMAIL PROTECTED]> wrote: > > I am running sol 10 on a Sun Enterprise 220R (2 X UltraSPARC-II > > 450MHz) with 1G real memory. > > > > It crashed twice in 5 days. Here are the mdb output > > > > (root)@syslog1:/var/crash/syslog1# mdb -k unix.0 vmcore.0 > > Loading modules: [ unix krtld genunix specfs dtrace ufs sd pcipsy ip > > hook neti sctp arp usba fctl md ptm cpc crypto fcip random zfs nfs > > lofs ipc ] > > > $c > > buf_hash_remove+0x40(3000cdd4d90, 30002ee4000, 6c2400, 704aa800, 3df8, > 1efc0) > > arc_change_state+0x170(704aea10, 3000cdd4d90, 704ae9d0, 0, 0, 704aea10) > > arc_evict_ghost+0x8c(704ae9a0, 0, 704aa858, 160c00, 3000ee02ee8, 704ae658) > > arc_adjust+0xc0(704aea10, 4160c00, 160c00, 704ae920, 722400, 704a8478) > > arc_kmem_reap_now+0x1c(0, 3c, 10, 13, 1, 704a8000) > > arc_reclaim_thread+0xe0(57c400, 2a100683aca, 2a100683ac8, 704aea50, > 401ca00, 0) > > thread_start+4(0, 0, 808bc01322400007, c8052000c206600c, > > 84006002c426600c, 10800006ca066008) > > > > (root)@syslog1:/var/crash/syslog1# mdb -k unix.1 vmcore.1 > > Loading modules: [ unix krtld genunix specfs dtrace ufs sd pcipsy ip > > hook neti sctp arp usba fctl zfs random nfs crypto ipc ptm logindmux > > md cpc fcp fcip lofs ] > > > $c > > vpanic(1200980, 7bb3f780, 7bb3f7a8, 69c, 1, 1) > > assfail+0x74(7bb3f780, 7bb3f7a8, 69c, 183dc00, 1200800, 0) > > dbuf_rele+0x158(3001678ade8, 3001678ad90, 3001678ad90, 0, 0, 7bb3f400) > > arc_write_done+0x158(3000c2e9240, 100, 0, 30009c45ce8, 30013609548, > 7baf5100) > > zio_done+0x134(0, a8, 30009c7a100, 701448c8, 3000c2e9240, 0) > > zio_vdev_io_assess+0x178(3000c2e9240, 8000, 20000, 0, 0, 10) > > taskq_thread+0x1a4(300037cdd18, 300037cdcc0, 50001, 1691e596d5ec9, > > 2a100807aca, 2a100807ac8) > > thread_start+4(300037cdcc0, 0, 10000000000000, 0, 0, 0) > > > > > > Here is the console output of the first crash > > > > Mar 18 14:19:08 syslog1 unix: [ID 836849 kern.notice] > > Mar 18 14:19:08 syslog1 ^Mpanic[cpu2]/thread=2a100683cc0: > > Mar 18 14:19:08 syslog1 unix: [ID 340138 kern.notice] BAD TRAP: > > type=31 rp=2a1006835f0 addr=30 mmu_fsr=0 occurred in module > > "zfs" due to a NULL pointer dereference > > Mar 18 14:19:09 syslog1 unix: [ID 100000 kern.notice] > > Mar 18 14:19:09 syslog1 unix: [ID 839527 kern.notice] sched: > > Mar 18 14:19:09 syslog1 unix: [ID 520581 kern.notice] trap type = 0x31 > > Mar 18 14:19:09 syslog1 unix: [ID 381800 kern.notice] addr=0x30 > > Mar 18 14:19:09 syslog1 unix: [ID 101969 kern.notice] pid=0, > > pc=0x7b74a2ec, sp=0x2a100682e91, tstate=0x9980001602, context=0 > > x0 > > Mar 18 14:19:09 syslog1 unix: [ID 743441 kern.notice] g1-g7: f6, > > a4ed3f84f7c910f7, 704b0008, 10, cf55406f17cca7f6, 0, 2a1006 > > 83cc0 > > Mar 18 14:19:09 syslog1 unix: [ID 100000 kern.notice] > > Mar 18 14:19:09 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100683310 unix:die+78 (31, 2a1006835f0, 30, 0, 2a1006833d0, > > 107b000) > > Mar 18 14:19:09 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000001fff 0000000000000031 0000000001000000 0000000 > > 000002000 > > Mar 18 14:19:09 syslog1 %l4-7: 000000000181a4f8 000000000181a400 > > 0000000000000000 00000000da5b6030 > > Mar 18 14:19:09 syslog1 genunix: [ID 723222 kern.notice] > > 000002a1006833f0 unix:trap+9d4 (2a1006835f0, 5, 1fff, 1c00, 0, 1) > > Mar 18 14:19:09 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000000 00000000018365b0 0000000000000031 0000000 > > 000000000 > > Mar 18 14:19:09 syslog1 %l4-7: ffffffffffffe000 00000300026915a0 > > 0000000000000001 0000000000000005 > > Mar 18 14:19:09 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100683540 unix:ktl0+48 (a4ed3f87f7cb7df8, 3000cdd4da0, 71b1d > > , cf55406f17cca7, 300026d0f, 0) > > Mar 18 14:19:09 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000003 0000000000001400 0000009980001602 0000000 > > 00101aee0 > > Mar 18 14:19:09 syslog1 %l4-7: 000003000006c240 0000000000000000 > > 0000000000000000 000002a1006835f0 > > Mar 18 14:19:10 syslog1 genunix: [ID 562518 kern.notice] > > 000002a100683690 30 (3000cdd4d90, 30002ee4000, 6c2400, 704aa800, 3d > > f8, 1efc0) > > Mar 18 14:19:10 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000000 0000030002ee4000 00000000704aa800 0000000 > > 0704a8000 > > Mar 18 14:19:10 syslog1 %l4-7: 0000000000000000 0000000000000200 > > 0000000000000000 0000000000000000 > > Mar 18 14:19:10 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100683740 zfs:arc_change_state+170 (704aea10, 3000cdd4d90, 7 > > 04ae9d0, 0, 0, 704aea10) > > Mar 18 14:19:10 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 00000000704ae9a0 0000000000020000 0000000000000000 0000000 > > 0008e9ff8 > > Mar 18 14:19:10 syslog1 %l4-7: 00000000704aea40 00000000704ae9a0 > > 00000000008e9ff7 00000000704aea10 > > Mar 18 14:19:10 syslog1 genunix: [ID 723222 kern.notice] > > 000002a1006837f0 zfs:arc_evict_ghost+8c (704ae9a0, 0, 704aa858, 160 > > c00, 3000ee02ee8, 704ae658) > > Mar 18 14:19:10 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 00000000704ae9d0 0000000000060000 000003000cdd4d90 0000000 > > 000003df8 > > Mar 18 14:19:10 syslog1 %l4-7: 0000000000003fff 0000000000020000 > > 00000000704a8000 00000000704ae800 > > Mar 18 14:19:10 syslog1 genunix: [ID 723222 kern.notice] > > 000002a1006838a0 zfs:arc_adjust+c0 (704aea10, 4160c00, 160c00, 704a > > e920, 722400, 704a8478) > > Mar 18 14:19:10 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 00000000704a84a8 0000000003a3e800 0000000003134e00 0000000 > > 0704ae9d8 > > Mar 18 14:19:10 syslog1 %l4-7: 0000000003a44e08 00000000003f6a00 > > 0000000003647e00 00000000704ae9d8 > > Mar 18 14:19:11 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100683950 zfs:arc_kmem_reap_now+1c (0, 3c, 10, 13, 1, 704a80 > > 00) > > Mar 18 14:19:11 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 000000000df8f3a2 00000000018ab800 0000000000000000 3ffffff > > e69c21670 > > Mar 18 14:19:11 syslog1 %l4-7: 0000000000000064 000000000df8f3a2 > > 00000000018ab800 00000000011ba000 > > Mar 18 14:19:11 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100683a00 zfs:arc_reclaim_thread+e0 (57c400, 2a100683aca, 2a > > 100683ac8, 704aea50, 401ca00, 0) > > Mar 18 14:19:11 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 000000000df90b15 0000000004598e00 0000000003b03e00 0000000 > > 0704ae930 > > Mar 18 14:19:11 syslog1 %l4-7: 00000000704a8004 00000000018abb30 > > 0000000001814228 0000000000000000 > > Mar 18 14:19:11 syslog1 unix: [ID 100000 kern.notice] > > Mar 18 14:19:11 syslog1 genunix: [ID 672855 kern.notice] syncing file > systems... > > Mar 18 14:19:11 syslog1 genunix: [ID 733762 kern.notice] 35 > > Mar 18 14:19:12 syslog1 genunix: [ID 733762 kern.notice] 1 > > Mar 18 14:19:34 syslog1 last message repeated 20 times > > Mar 18 14:19:35 syslog1 genunix: [ID 622722 kern.notice] done (not all > > i/o completed) > > Mar 18 14:19:36 syslog1 genunix: [ID 111219 kern.notice] dumping to > > /dev/dsk/c0t0d0s1, offset 214827008, content: kernel > > Mar 18 14:19:57 syslog1 genunix: [ID 409368 kern.notice] ^M100% done: > > 36326 pages dumped, compression ratio 2.92, > > Mar 18 14:19:57 syslog1 genunix: [ID 851671 kern.notice] dump succeeded > > Mar 18 14:21:05 syslog1 genunix: [ID 540533 kern.notice] ^MSunOS > > Release 5.10 Version Generic_120011-14 64-bit > > Mar 18 14:21:05 syslog1 genunix: [ID 943907 kern.notice] Copyright > > 1983-2007 Sun Microsystems, Inc. All rights reserved. > > > > > > Here is the console output of the second crash > > > > Mar 23 04:37:36 syslog1 unix: [ID 836849 kern.notice] > > Mar 23 04:37:36 syslog1 ^Mpanic[cpu2]/thread=2a100807cc0: > > Mar 23 04:37:36 syslog1 unix: [ID 403854 kern.notice] assertion > > failed: arc_buf_remove_ref(db->db_buf, db) == 0, file: ../. > > ./common/fs/zfs/dbuf.c, line: 1692 > > Mar 23 04:37:36 syslog1 unix: [ID 100000 kern.notice] > > Mar 23 04:37:36 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807660 genunix:assfail+74 (7bb3f780, 7bb3f7a8, 69c, 183d > > c00, 1200800, 0) > > Mar 23 04:37:36 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000001 0000000070146800 0000000000000034 000000 > > 0000002d34 > > Mar 23 04:37:36 syslog1 %l4-7: 0000000001200800 0000000000000000 > > 0000000001875800 0000000000000000 > > Mar 23 04:37:36 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807710 zfs:dbuf_rele+158 (3001678ade8, 3001678ad90, 3001 > > 678ad90, 0, 0, 7bb3f400) > > Mar 23 04:37:36 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000000 0000000000000000 0000000000000000 000000 > > 0000000000 > > Mar 23 04:37:36 syslog1 %l4-7: 0000000000000000 0000000000000000 > > 0000000000000000 0000000000000002 > > Mar 23 04:37:37 syslog1 genunix: [ID 723222 kern.notice] > > 000002a1008077c0 zfs:arc_write_done+158 (3000c2e9240, 100, 0, 3000 > > 9c45ce8, 30013609548, 7baf5100) > > Mar 23 04:37:37 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000000 000000000000000f 0000000000000007 000000 > > 0000000100 > > Mar 23 04:37:37 syslog1 %l4-7: 56e42a2c5b6ce35a 0000030009c7a100 > > 0000030009c7a100 000000000100ad00 > > Mar 23 04:37:37 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807880 zfs:zio_done+134 (0, a8, 30009c7a100, 701448c8, 3 > > 000c2e9240, 0) > > Mar 23 04:37:37 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807880 zfs:zio_done+134 (0, a8, 30009c7a100, 701448c8, 3 > > 000c2e9240, 0) > > Mar 23 04:37:37 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 00000300020c9240 0000030016315480 0000000000000005 000000 > > 0020db65bb > > Mar 23 04:37:37 syslog1 %l4-7: 000000007baf11f0 0000000000085c5e > > 0000000000000000 0000000000000000 > > Mar 23 04:37:37 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807940 zfs:zio_vdev_io_assess+178 (3000c2e9240, 8000, 20 > > 000, 0, 0, 10) > > Mar 23 04:37:37 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000000002 0000000000000001 0000000000000000 000000 > > 0000000000 > > Mar 23 04:37:37 syslog1 %l4-7: 0000000000000000 0000000000000001 > > 0000000000000000 000002a100807960 > > Mar 23 04:37:37 syslog1 genunix: [ID 723222 kern.notice] > > 000002a100807a00 genunix:taskq_thread+1a4 (300037cdd18, 300037cdcc > > 0, 50001, 1691e596d5ec9, 2a100807aca, 2a100807ac8) > > Mar 23 04:37:37 syslog1 genunix: [ID 179002 kern.notice] %l0-3: > > 0000000000010000 00000300037cdce8 00000300037cdcf0 000003 > > 00037cdcf2 > > Mar 23 04:37:37 syslog1 %l4-7: 00000300141f9bc8 0000000000000002 > > 0000000000000000 00000300037cdce0 > > Mar 23 04:37:38 syslog1 unix: [ID 100000 kern.notice] > > Mar 23 04:37:38 syslog1 genunix: [ID 672855 kern.notice] syncing file > systems... > > Mar 23 04:38:07 syslog1 unix: [ID 836849 kern.notice] > > Mar 23 04:38:07 syslog1 ^Mpanic[cpu2]/thread=2a100807cc0: > > Mar 23 04:38:07 syslog1 unix: [ID 715357 kern.notice] panic sync timeout > > Mar 23 04:38:07 syslog1 unix: [ID 100000 kern.notice] > > Mar 23 04:38:07 syslog1 genunix: [ID 111219 kern.notice] dumping to > > /dev/dsk/c0t0d0s1, offset 214827008, content: kernel > > Mar 23 04:38:07 syslog1 scsi: [ID 107833 kern.warning] WARNING: > > /[EMAIL PROTECTED],4000/[EMAIL PROTECTED] (glm0): > > Mar 23 04:38:07 syslog1 got SCSI bus reset > > Mar 23 04:38:07 syslog1 genunix: [ID 408822 kern.info] NOTICE: glm0: > > fault detected in device; service still available > > Mar 23 04:38:07 syslog1 genunix: [ID 611667 kern.info] NOTICE: glm0: > > got SCSI bus reset > > Mar 23 04:38:30 syslog1 genunix: [ID 409368 kern.notice] ^M100% done: > > 39574 pages dumped, compression ratio 2.92, > > Mar 23 04:38:30 syslog1 genunix: [ID 851671 kern.notice] dump succeeded > > Mar 23 04:39:37 syslog1 genunix: [ID 540533 kern.notice] ^MSunOS > > Release 5.10 Version Generic_120011-14 64-bit > > Mar 23 04:39:37 syslog1 genunix: [ID 943907 kern.notice] Copyright > > 1983-2007 Sun Microsystems, Inc. All rights reserved. > > > > > > -- > > Asif Iqbal > > PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu > > > > > > -- > Asif Iqbal > PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu >
-- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
