Re: [zfs-discuss] ZFS pool unusable after attempting to destroy a dataset with dedup enabled

2009-12-26 Thread Jack Kielsmeier
Just wondering, How much RAM is in your system? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] ZFS pool unusable after attempting to destroy a dataset with dedup enabled

2009-12-26 Thread Jack Kielsmeier
I still haven't given up :) I moved my Virtual Machines to my main rig (which gets rebooted often, so this is 'not optimal' to say the least) :) I have since upgraded to 129. I noticed that even if timeslider/autosnaps are disabled, a zpool command still gets generated every 15 minutes. Since a

[zfs-discuss] repost - high read iops

2009-12-26 Thread Brad
repost - Sorry for ccing the other forums. I'm running into a issue where there seems to be a high number of read iops hitting disks and physical free memory is fluctuating between 200MB -> 450MB out of 16GB total. We have the l2arc configured on a 32GB Intel X25-E ssd and slog on another 32GB

Re: [zfs-discuss] ZFS pool unusable after attempting to destroy a dataset with dedup enabled

2009-12-26 Thread tom wagner
I am having the exact same problem after destroying a dataset with a few gigabytes of data and dedup. I type zfs destroy vault/virtualmachines which was a zvol with dedup turned on and the server hung, couldn't ping, couldn't get on the console. Next bootup same thing just hangs when importing

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Saso Kiselkov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Thanks for the advice. I did an in-place upgrade to the latest development b130 release and it seems that the change in scheduling classes for the kernel writer threads worked (not even having to fiddle around with logbias) - now I'm just getting small

Re: [zfs-discuss] Benchmarks results for ZFS + NFS, using SSD's as slog devices (ZIL)

2009-12-26 Thread Richard Elling
On Dec 25, 2009, at 3:01 PM, Jeroen Roodhart wrote: -BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 Hi Freddie, list, Option 4 is to re-do your pool, using fewer disks per raidz2 vdev, giving more vdevs to the pool, and thus increasing the IOps for the whole pool. 14 disks in a single rai

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Richard Elling
On Dec 26, 2009, at 1:10 AM, Saso Kiselkov wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Brent Jones wrote: On Fri, Dec 25, 2009 at 9:56 PM, Tim Cook wrote: On Fri, Dec 25, 2009 at 11:43 PM, Brent Jones wrote: Hang on... if you've got 77 concurrent threads going, I don't se

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Menno Lageman
On 12/26/09 09:53, Brent Jones wrote: On Fri, Dec 25, 2009 at 9:56 PM, Tim Cook wrote: On Fri, Dec 25, 2009 at 11:43 PM, Brent Jones wrote: Hang on... if you've got 77 concurrent threads going, I don't see how that's a "sequential" I/O load. To the backend storage it's going to look

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Bob Friesenhahn
On Fri, 25 Dec 2009, Saso Kiselkov wrote: sometimes even longer. I figured that I might be able to resolve this by lowering the txg timeout to something like 1-2 seconds (I need ZFS to write as soon as data arrives, since it will likely never be overwritten), but I couldn't find any tunable param

Re: [zfs-discuss] Benchmarks results for ZFS + NFS, using SSD's as slog devices (ZIL)

2009-12-26 Thread Erik Trimble
Richard Elling wrote: On Dec 25, 2009, at 4:15 PM, Erik Trimble wrote: I haven't seen this mentioned before, but the OCZ Vertex Turbo is still an MLC-based SSD, and is /substantially/ inferior to an Intel X25-E in terms of random write performance, which is what a ZIL device does almost excl

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Saso Kiselkov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Thank you, the post you mentioned helped me move a bit forward. I tried putting: zfs:zfs_txg_timeout = 1 in /etc/system and now I'm getting much more even write load (a burst every 5 seconds), which now does not cause any significant poll() stalling

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Fajar A. Nugraha
On Sat, Dec 26, 2009 at 4:10 PM, Saso Kiselkov wrote: >> I'm still trying to find the case number I have open with Sunsolve or >> whatever, it was for exactly this issue, and I believe the fix was to >> add dozens more "classes" to the scheduler, to allow more fair disk >> I/O and overall "nicenes

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Saso Kiselkov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Brent Jones wrote: > On Fri, Dec 25, 2009 at 9:56 PM, Tim Cook wrote: >> >> On Fri, Dec 25, 2009 at 11:43 PM, Brent Jones wrote: > Hang on... if you've got 77 concurrent threads going, I don't see how that's a "sequential" I/O

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Brent Jones
On Fri, Dec 25, 2009 at 9:56 PM, Tim Cook wrote: > > > On Fri, Dec 25, 2009 at 11:43 PM, Brent Jones wrote: >> >> >> >> >> >> > >> > >> > Hang on... if you've got 77 concurrent threads going, I don't see how >> > that's >> > a "sequential" I/O load.  To the backend storage it's going to look like

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Saso Kiselkov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Would an upgrade to the development repository of 2010.02 do the same? I'd like to avoid having to do a complete reinstall, since I've got quite a bit of custom software in the system already in various places and recompiling and fine-tuning would take

Re: [zfs-discuss] ZFS write bursts cause short app stalls

2009-12-26 Thread Saso Kiselkov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 The application I'm working on is a kind of large-scale network-PVR system for our IPTV services. It records all running TV channels in a X-hour carrousel (typically 24 or 48-hours), retaining only those bits which users have marked as being interestin