Hello,
I'm investigating problem with ZFS over NFS.
The problems started about 2 weeks ago, most nfs threads are hanging in
txg_wait_open.
Sync thread is consuming one processor all the time,
Average spa_sync function times from entry to return is 2 minutes.
I can't use dtrace to examine problem, because I keep getting:
dtrace: processing aborted: Abort due to systemic unresponsiveness
Using mdb and examining tx_sync_thread with ::findstack I keep getting this
stack:
fffffe8002da1410 _resume_from_idle+0xf8() ]
fffffe8002da1570 avl_walk+0x39()
fffffe8002da15a0 space_map_alloc+0x21()
fffffe8002da1620 metaslab_group_alloc+0x1a2()
fffffe8002da16b0 metaslab_alloc_dva+0xab()
fffffe8002da1700 metaslab_alloc+0x51()
fffffe8002da1720 zio_dva_allocate+0x3f()
fffffe8002da1730 zio_next_stage+0x72()
fffffe8002da1750 zio_checksum_generate+0x5f()
fffffe8002da1760 zio_next_stage+0x72()
fffffe8002da17b0 zio_write_compress+0x136()
fffffe8002da17c0 zio_next_stage+0x72()
fffffe8002da17f0 zio_wait_for_children+0x49()
fffffe8002da1800 zio_wait_children_ready+0x15()
fffffe8002da1810 zio_next_stage_async+0xae()
fffffe8002da1820 zio_nowait+9()
fffffe8002da18b0 arc_write+0xe7()
fffffe8002da19a0 dbuf_sync+0x274()
fffffe8002da1a10 dnode_sync+0x2e3()
fffffe8002da1a60 dmu_objset_sync_dnodes+0x7b()
fffffe8002da1af0 dmu_objset_sync+0x6a()
fffffe8002da1b10 dsl_dataset_sync+0x23()
fffffe8002da1b60 dsl_pool_sync+0x7b()
fffffe8002da1bd0 spa_sync+0x116()
I also managed to sum metaslabs space maps:
::walk spa | ::walk metaslab | ::print struct metaslab ms_smo.smo_objsize
and I got 1GB.
I have a pool 1,3T with 500G avail space.
Pool was created about 3 months ago.
I'm using solaris 10 u3
Do you think changing system to nevada will help ?
I red that there are some changes that can help:
http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6512391
http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6532056
This message posted from opensolaris.org
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
