[zfs-discuss] ssd pool + ssd cache ?

2010-01-08 Thread Francois
Hi list, Experimental question ... Imagine a pool made of SSDs disks, is there any interest to add a SSD cache to it ? What real impact ? Thx. -- Francois ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/lis

[zfs-discuss] I/O Read starvation

2010-01-08 Thread bank kus
dd if=/dev/urandom of=largefile.txt bs=1G count=8 cp largefile.txt ./test/1.txt & cp largefile.txt ./test/2.txt & Thats it now the system is totally unusable after launching the two 8G copies. Until these copies finish no other application is able to launch completely. Checking prstat shows the

[zfs-discuss] unable to zfs destroy

2010-01-08 Thread Rob Logan
this one has me alittle confused. ideas? j...@opensolaris:~# zpool import z cannot mount 'z/nukeme': mountpoint or dataset is busy cannot share 'z/cle2003-1': smb add share failed j...@opensolaris:~# zfs destroy z/nukeme internal error: Bad exchange descriptor Abort (core dumped) j...@opensolaris

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Lee
On 01/08/2010 02:42 PM, Lutz Schumann wrote: > See the reads on the pool with the low I/O ? I suspect reading the > DDT causes the writes to slow down. > > See this bug > http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6913566. > It seems to give some backgrounds. > > Can you test sett

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Dickens
On Fri, Jan 8, 2010 at 1:44 PM, Ian Collins wrote: > James Lee wrote: > >> I haven't seen much discussion on how deduplication affects performance. >> I've enabled dudup on my 4-disk raidz array and have seen a significant >> drop in write throughput, from about 100 MB/s to 3 MB/s. I can't >> i

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Ian Collins
James Lee wrote: I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I can't imagine such a decrease is normal. What is you data? I've foun

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Lutz Schumann
See the reads on the pool with the low I/O ? I suspect reading the DDT causes the writes to slow down. See this bug http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6913566. It seems to give some backgrounds. Can you test setting the "primarycache=metadata" on the volume you test ?

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Mike Gerdts
On Fri, Jan 8, 2010 at 12:28 PM, Torrey McMahon wrote: > On 1/8/2010 10:04 AM, James Carlson wrote: >> >> Mike Gerdts wrote: >> >>> >>> This unsupported feature is supported with the use of Sun Ops Center >>> 2.5 when a zone is put on a "NAS Storage Library". >>> >> >> Ah, ok.  I didn't know that.

Re: [zfs-discuss] link in zpool upgrade -v broken

2010-01-08 Thread Ian Collins
Cindy Swearingen wrote: Hi Ian, I see the problem. In your included URL below, you didn't include the /N suffix as included in the zpool upgrade output. That's correct, N is the version number. I see it is fixed now, thanks. -- Ian. ___ zfs-discus

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Richard Elling
On Jan 8, 2010, at 6:20 AM, Frank Batschulat (Home) wrote: On Fri, 08 Jan 2010 13:55:13 +0100, Darren J Moffat > wrote: Frank Batschulat (Home) wrote: This just can't be an accident, there must be some coincidence and thus there's a good chance that these CHKSUM errors must have a common sou

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Torrey McMahon
On 1/8/2010 10:04 AM, James Carlson wrote: Mike Gerdts wrote: This unsupported feature is supported with the use of Sun Ops Center 2.5 when a zone is put on a "NAS Storage Library". Ah, ok. I didn't know that. Does anyone know how that works? I can't find it in the docs, no on

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread James Carlson
Mike Gerdts wrote: > This unsupported feature is supported with the use of Sun Ops Center > 2.5 when a zone is put on a "NAS Storage Library". Ah, ok. I didn't know that. -- James Carlson 42.703N 71.076W ___ zfs-discuss mailing list z

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Frank Batschulat (Home)
On Fri, 08 Jan 2010 13:55:13 +0100, Darren J Moffat wrote: > Frank Batschulat (Home) wrote: >> This just can't be an accident, there must be some coincidence and thus >> there's a good chance >> that these CHKSUM errors must have a common source, either in ZFS or in NFS ? > > What are you using

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread James Carlson
Frank Batschulat (Home) wrote: > This just can't be an accident, there must be some coincidence and thus > there's a good chance > that these CHKSUM errors must have a common source, either in ZFS or in NFS ? One possible cause would be a lack of substantial exercise. The man page says:

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Ray Van Dolson
On Fri, Jan 08, 2010 at 10:00:14AM -0800, James Lee wrote: > I haven't seen much discussion on how deduplication affects performance. > I've enabled dudup on my 4-disk raidz array and have seen a significant > drop in write throughput, from about 100 MB/s to 3 MB/s. I can't > imagine such a decre

[zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Lee
I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I can't imagine such a decrease is normal. > # zpool iostat nest 1 (with dedup enabled): > ...

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Mike Gerdts
On Fri, Jan 8, 2010 at 9:11 AM, Mike Gerdts wrote: > I've seen similar errors on Solaris 10 in the primary domain and on a > M4000.  Unfortunately Solaris 10 doesn't show the checksums in the > ereport.  There I noticed a mixture between read errors and checksum > errors - and lots more of them.  

[zfs-discuss] ZFS partially hangs when removing an rpool mirrored disk while having some IO on another pool on another partition of the same disk

2010-01-08 Thread Arnaud Brand
Hello, Sorry for the (very) long subject but I've pinpointed the problem to this exact situation. I know about the other threads related to hangs, but in my case there was no < zfs destroy > involved, nor any compression or deduplication. To make a long story short, when - a disk contains

Re: [zfs-discuss] (Practical) limit on the number of snapshots?

2010-01-08 Thread Bob Friesenhahn
On Fri, 8 Jan 2010, Peter van Gemert wrote: I don't think the use of snapshots will alter the way data is fragmented or localized on disk. What happens after a snapshot is deleted? Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagic

Re: [zfs-discuss] zpool iostat -v hangs on L2ARC failure (SATA, 160 GB Postville)

2010-01-08 Thread Lutz Schumann
Ok, after browsing I found that the sata disks are not shown via cfgadm. I found http://opensolaris.org/jive/message.jspa?messageID=287791&tstart=0 which states that you have to set the mode to "AHCI" to enable hot-plug etc. However I sill think, also the plain IDE driver needs a timeout to han

Re: [zfs-discuss] link in zpool upgrade -v broken

2010-01-08 Thread Cindy Swearingen
Hi Ian, I see the problem. In your included URL below, you didn't include the /N suffix as included in the zpool upgrade output. CR 6898657 is still filed to identify the change. If you copy and paste the URL from the zpool upgrade -v output: http://www.opensolaris.org/os/community/zfs/version

Re: [zfs-discuss] (Practical) limit on the number of snapshots?

2010-01-08 Thread Robert Milkowski
On 08/01/2010 14:50, David Dyer-Bennet wrote: On Fri, January 8, 2010 07:51, Robert Milkowski wrote: On 08/01/2010 12:40, Peter van Gemert wrote: By having a snapshot you are not releasing the space forcing zfs to allocate new space from other parts of a disk drive. This may lead (dep

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Mike Gerdts
On Fri, Jan 8, 2010 at 5:28 AM, Frank Batschulat (Home) wrote: [snip] > Hey Mike, you're not the only victim of these strange CHKSUM errors, I hit > the same during my slightely different testing, where I'm NFS mounting an > entire, pre-existing remote file living in the zpool on the NFS server an

Re: [zfs-discuss] I/O errors after zfs promote back and forth

2010-01-08 Thread Nils Goroll
BTW, this was on snv_111b - sorry I forgot to mention. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

[zfs-discuss] I/O errors after zfs promote back and forth

2010-01-08 Thread Nils Goroll
Hi, I have just observed the following issue and I would like to ask if it is already known: I'm using zones on ZFS filesystems which were cloned from a common template (which is itself an original filesystem). A couple of weeks ago, I did a pkg image-update, so all zone roots got cloned aga

Re: [zfs-discuss] (Practical) limit on the number of snapshots?

2010-01-08 Thread David Dyer-Bennet
On Fri, January 8, 2010 07:51, Robert Milkowski wrote: > On 08/01/2010 12:40, Peter van Gemert wrote: >>> By having a snapshot you >>> are not releasing the >>> space forcing zfs to allocate new space from other >>> parts of a disk >>> drive. This may lead (depending on workload) to more >>> fragm

Re: [zfs-discuss] zpool iostat -v hangs on L2ARC failure (SATA, 160 GB Postville)

2010-01-08 Thread Lutz Schumann
Ok, I now waited 30 minutes - still hung. After that I pulled the SATA cable to the L2ARC device also - still no success (I waited 10 minutes). After 10 minutes I put the L2ARC device back (SATA + Power) 20 seconds after that the system continues to run. dmesg shows: Jan 8 15:41:57 nexe

[zfs-discuss] zpool iostat -v hangs on L2ARC failure (SATA, 160 GB Postville)

2010-01-08 Thread Lutz Schumann
Hello, today I wanted to test that the failure of the L2ARC device is not crucial to the pool. I added a Intel X25-M Postville (160GB) as cache device to a 54 disk mittor pool. Then I startet a SYNC iozone on the pool: iozone -ec -r 32k -s 2048m -l 2 -i 0 -i 2 -o Pool: pool mirror-0

Re: [zfs-discuss] Thin device support in ZFS?

2010-01-08 Thread Daniel Carosone
Yet another way to thin-out the backing devices for a zpool on a thin-provisioned storage host, today: resilver. If your zpool has some redundancy across the SAN backing LUNs, simply drop and replace one at a time and allow zfs to resilver only the blocks currently in use onto the replacement LUN

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Mike Gerdts
On Fri, Jan 8, 2010 at 6:51 AM, James Carlson wrote: > Frank Batschulat (Home) wrote: >> This just can't be an accident, there must be some coincidence and thus >> there's a good chance >> that these CHKSUM errors must have a common source, either in ZFS or in NFS ? > > One possible cause would b

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Mike Gerdts
On Fri, Jan 8, 2010 at 6:55 AM, Darren J Moffat wrote: > Frank Batschulat (Home) wrote: >> >> This just can't be an accident, there must be some coincidence and thus >> there's a good chance >> that these CHKSUM errors must have a common source, either in ZFS or in >> NFS ? > > What are you using

Re: [zfs-discuss] (Practical) limit on the number of snapshots?

2010-01-08 Thread Robert Milkowski
On 08/01/2010 12:40, Peter van Gemert wrote: By having a snapshot you are not releasing the space forcing zfs to allocate new space from other parts of a disk drive. This may lead (depending on workload) to more fragmentation, less localized data (more and longer seeks). ZFS uses COW (cop

[zfs-discuss] Detecting quota limits

2010-01-08 Thread Martijn de Munnik
Hi List, We create a zfs filesystem for each user's homedir. I would like to monitor their usage and when the user approaches his quota I would like to receive a warning by mail. Does anybody have a script available which does this job and can be run using a cron job. Or even better, is this a bui

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Darren J Moffat
Frank Batschulat (Home) wrote: This just can't be an accident, there must be some coincidence and thus there's a good chance that these CHKSUM errors must have a common source, either in ZFS or in NFS ? What are you using for on the wire protection with NFS ? Is it shared using krb5i or do y

Re: [zfs-discuss] [zones-discuss] Zones on shared storage - a warning

2010-01-08 Thread Frank Batschulat (Home)
On Wed, 23 Dec 2009 03:02:47 +0100, Mike Gerdts wrote: > I've been playing around with zones on NFS a bit and have run into > what looks to be a pretty bad snag - ZFS keeps seeing read and/or > checksum errors. This exists with S10u8 and OpenSolaris dev build > snv_129. This is likely a blocker

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-08 Thread marty scholes
--- On Thu, 1/7/10, Tiernan OToole wrote: > Sorry to hijack the thread, but can you > explain your setup? Sounds interesting, but need more > info... This is just a home setup to amuse me and placate my three boys, each of whom has several Windows instances running under Virtualbox. Server is a

Re: [zfs-discuss] (Practical) limit on the number of snapshots?

2010-01-08 Thread Peter van Gemert
> By having a snapshot you > are not releasing the > space forcing zfs to allocate new space from other > parts of a disk > drive. This may lead (depending on workload) to more > fragmentation, less > localized data (more and longer seeks). > ZFS uses COW (copy on write) during writes. This me

Re: [zfs-discuss] ZFS pool unusable after attempting to destroy a dataset with dedup enabled

2010-01-08 Thread Jack Kielsmeier
I'm thinking that the issue is simply with zfs destroy, not with dedup or compression. Yesterday I decided to do some iscsi testing, I created a new dataset in my pool, 1TB. I did not use compression or dedup. After copying about 700GB of data from my windows box (NTFS on top of the iscsi disk