Re: [zfs-discuss] How often to scrub?

2008-12-01 Thread Richard Elling
Glaser, David wrote: > > Hi all, > > I have a Thumper (ok, actually 3) with each having one large pool, > multiple filesystems and many snapshots. They are holding rsync copies > of multiple clients, being synced every night (using snapshots to keep > ‘incremental’ backups). > > I’m wondering ho

Re: [zfs-discuss] zpool replace - choke point

2008-12-01 Thread Alan Rubin
We will be considering it in the new year, but that will not happen in time to affect our current SAN migration. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/li

Re: [zfs-discuss] Is SUNWhd for Thumper only?

2008-12-01 Thread Blake
Also, see the 'hd -e' option (unless this works only with the Marvell chipset): [EMAIL PROTECTED] ~]# hd -e c3t1 Revision: 16 Offline status 132 Selftest status 0 Seconds to collect 15960 Time in minutes to run short selftest 2 Time in minutes to run extended selftest 198 Offline capability 123 SM

Re: [zfs-discuss] How often to scrub?

2008-12-01 Thread Toby Thain
On 1-Dec-08, at 10:05 PM, Glaser, David wrote: > Hi all, > > > > I have a Thumper (ok, actually 3) with each having one large pool, > multiple filesystems and many snapshots. They are holding rsync > copies of multiple clients, being synced every night (using > snapshots to keep ‘incrementa

Re: [zfs-discuss] zpool replace - choke point

2008-12-01 Thread Blake
Have you considered moving to 10/08 ? ZFS resilver performance is much improved in this release, and I suspect that code might help you. You can easily test upgrading with Live Upgrade. I did the transition using LU and was very happy with the results. For example, I added a disk to a mirror an

[zfs-discuss] zpool replace - choke point

2008-12-01 Thread Alan Rubin
I had posted at the Sun forums, but it was recommended to me to try here as well. For reference, please see http://forums.sun.com/thread.jspa?threadID=5351916&tstart=0. In the process of a large SAN migration project we are moving many large volumes from the old SAN to the new. We are making u

Re: [zfs-discuss] How often to scrub? [SEC=UNCLASSIFIED]

2008-12-01 Thread LEES, Cooper
Hi, I scrub my pools once a week on the weekend, rpool saturday, cesspool (my other pool) Sunday. You can still use the box while it is scrubbing but as you would expect the I/O is very slow and can sometimes be close to unusable. Ta, --- Cooper Ry Lees UNIX Evangelist - Information Manag

[zfs-discuss] How often to scrub?

2008-12-01 Thread Glaser, David
Hi all, I have a Thumper (ok, actually 3) with each having one large pool, multiple filesystems and many snapshots. They are holding rsync copies of multiple clients, being synced every night (using snapshots to keep 'incremental' backups). I'm wondering how often (if ever) I should do scrubs

[zfs-discuss] ZFS UI management

2008-12-01 Thread Jean Dion
I there a plan to add send/receive functions to ZFS UI (Java Console)? You should consider adding ZFS UI like Time Slider rather than just Java Console. We also need ways to ease recovery of an entire file systems from local or remote. Timer Slider focus on zfs level only. Be nice to add enti

Re: [zfs-discuss] Is SUNWhd for Thumper only?

2008-12-01 Thread Blake Irvin
I've used that tool only with the Marvell chipset that ships with the thumpers. (in a supermicro hba) Have you looked at cfgadm? Blake On Dec 1, 2008, at 7:49 PM, [EMAIL PROTECTED] wrote: >> (http://cuddletech.com/blog/pivot/entry.php?id=993). Will the SUNWhd > > can't dump all SMART data, b

Re: [zfs-discuss] rsync using 100% of a cpu

2008-12-01 Thread Blake Irvin
Upstream when using DSL is much slower than downstream? Blake On Dec 1, 2008, at 7:42 PM, "Francois Dion" <[EMAIL PROTECTED]> wrote: Source is local to rsync, copying from a zfs file system, destination is remote over a dsl connection. Takes forever to just go through the unchanged files

Re: [zfs-discuss] Is SUNWhd for Thumper only?

2008-12-01 Thread Rob
> (http://cuddletech.com/blog/pivot/entry.php?id=993). Will the SUNWhd can't dump all SMART data, but get some temps on a generic box.. 4 % hd -a fdisk DeviceSerialVendor Model Rev Temperature Type --

[zfs-discuss] rsync using 100% of a cpu

2008-12-01 Thread Francois Dion
Source is local to rsync, copying from a zfs file system, destination is remote over a dsl connection. Takes forever to just go through the unchanged files. Going the other way is not a problem, it takes a fraction of the time. Anybody seen that? Suggestions? ___

Re: [zfs-discuss] Slow death-spiral with zfs gzip-9 compression

2008-12-01 Thread Ray Clark
Re pantzer5's suggestion: Memory is not a big problem for ZFS, address space is. You may have to give the kernel more address space on 32-bit CPUs. eeprom kernelbase=0x8000 This will reduce the usable address space of user processes though. --- Would you please verify that I understand co

Re: [zfs-discuss] Separate /var

2008-12-01 Thread Lori Alt
On 11/27/08 17:18, Gary Mills wrote: On Fri, Nov 28, 2008 at 11:19:14AM +1300, Ian Collins wrote: On Fri 28/11/08 10:53 , Gary Mills [EMAIL PROTECTED] sent: On Fri, Nov 28, 2008 at 07:39:43AM +1100, Edward Irvine wrote: I'm currently working with an organisation who wa

Re: [zfs-discuss] s10u6--will using disk slices for zfs logs improve nfs performance?

2008-12-01 Thread Richard Elling
Nicholas Lee wrote: > > > On Sat, Nov 15, 2008 at 7:54 AM, Richard Elling > <[EMAIL PROTECTED] > wrote: > > In short, separate logs with rotating rust may reduce sync write > latency by > perhaps 2-10x on an otherwise busy system. Using write optimized SSDs >

Re: [zfs-discuss] Slow death-spiral with zfs gzip-9 compression

2008-12-01 Thread Ray Clark
It completed copying 191,xxx MB without issue in 17 hours and 40 minutes, average transfer rate of 3.0MB/Sec. During the copy (At least the first hour or so, and an hour in the middle), the machine was reasonably responsive. It was jerky to a greater or lesser extent, but nothing like even the

Re: [zfs-discuss] Gnome Disk Usage Analyzer

2008-12-01 Thread Ross
Hmm... and on my second attempt it run way faster, enumerates all folders and doesn't lock the system up at all. The totals are still wrong, but the performance is completely different. I suspect it's just ZFS being slow after a reboot (with no data in the cache), will test this at work tomorr

Re: [zfs-discuss] Gnome Disk Usage Analyzer

2008-12-01 Thread Ross
Hmm, there appear to be a few bugs with it actually. In addition to locking up the system while scanning, it seems to have created a circular reference. It looks like it hasn't been able to finish scanning the folders, and has wound up creating a link back to the ZFS root with the last folder

Re: [zfs-discuss] ZFS ACL/ACE issues with Samba - Access Denied

2008-12-01 Thread Scott Williamson
Hi, On Mon, Dec 1, 2008 at 3:37 PM, Eric Hill <[EMAIL PROTECTED]> wrote: > Any thoughts on how come Solaris/id isn't seeing the full group list for the > user? Do an ldapsearch and dump the attributes for the group. If it is using memberuid to list the members solaris should work, if you are usi

Re: [zfs-discuss] s10u6--will using disk slices for zfs logs improve nfs performance?

2008-12-01 Thread Roch Bourbonnais
Le 15 nov. 08 à 08:49, Nicholas Lee a écrit : > > > On Sat, Nov 15, 2008 at 7:54 AM, Richard Elling <[EMAIL PROTECTED] > > wrote: > In short, separate logs with rotating rust may reduce sync write > latency by > perhaps 2-10x on an otherwise busy system. Using write optimized SSDs > will redu

Re: [zfs-discuss] Gnome Disk Usage Analyzer

2008-12-01 Thread Ross
Aaah, nm, found it. It's under a different menu in OpenSolaris, and looks like it scans ZFS fine. There doesn't appear to be any way to stop a scan once you've started it though, the entire GUI looks to have frozen up on me. -- This message posted from opensolaris.org _

[zfs-discuss] Gnome Disk Usage Analyzer

2008-12-01 Thread Ross
Hey folks, With OpenSolaris incorporating gnome these days, will things like the Disk Usage Analyzer be included, and will that work with ZFS? http://www.simplehelp.net/2008/11/04/how-to-analyze-disk-usage-in-ubuntu/ Ross -- This message posted from opensolaris.org _

Re: [zfs-discuss] ZFS ACL/ACE issues with Samba - Access Denied

2008-12-01 Thread Eric Hill
Well, there's the problem... #id -a tom uid=15669(tom) gid=15004(domain users) groups=15004(domain users) # wbinfo -r shows the full list of groups, but id -a only lists "domain users". Since I'm trying to restrict permissions on other groups, my access denied error message makes more sense.

Re: [zfs-discuss] Is SUNWhd for Thumper only?

2008-12-01 Thread Scott Williamson
Try it and tell us if it works :) It might have hooks into the specific controller driver. On Mon, Dec 1, 2008 at 1:45 PM, Joe S <[EMAIL PROTECTED]> wrote: > I read Ben Rockwood's blog post about Thumpers and SMART > (http://cuddletech.com/blog/pivot/entry.php?id=993). Will the SUNWhd > package o

[zfs-discuss] Is SUNWhd for Thumper only?

2008-12-01 Thread Joe S
I read Ben Rockwood's blog post about Thumpers and SMART (http://cuddletech.com/blog/pivot/entry.php?id=993). Will the SUNWhd package only work on a Thumper? Can I use this on my snv_101 system with AMD 64 bit processor and nVidia SATA? ___ zfs-discuss ma

Re: [zfs-discuss] Slow death-spiral with zfs gzip-9 compression

2008-12-01 Thread Bob Friesenhahn
On Mon, 1 Dec 2008, Karl Rossing wrote: > > I'm not familiar with fs design. There are probably compelling technical > and compliance reasons not to do any of my suggestions. Due to ZFS COW design, each re-compression requires allocation of a new block. This has implications when snapshots and c

Re: [zfs-discuss] Slow death-spiral with zfs gzip-9 compression

2008-12-01 Thread Karl Rossing
Could zfs be configured to use gzip-9 to compress small files or when the system is idle.. When the system is busy or is handling a large file use lzjb. Busy/Idle and large/small files would need to be defined somewhere. Alternatively, write the file out using lzjb if the system is busy and go

Re: [zfs-discuss] ZFS space efficiency when copying files from

2008-12-01 Thread BJ Quinn
Should I set that as rsync's block size? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] ZFS space efficiency when copying files from

2008-12-01 Thread Darren J Moffat
BJ Quinn wrote: > Oh. Yup, I had figured this out on my own but forgot to post back. > --inplace accomplishes what we're talking about. --no-whole-file is also > necessary if copying files locally (not over the network), because rsync does > default to only copying changed blocks, but it over

Re: [zfs-discuss] ZFS space efficiency when copying files from

2008-12-01 Thread BJ Quinn
Oh. Yup, I had figured this out on my own but forgot to post back. --inplace accomplishes what we're talking about. --no-whole-file is also necessary if copying files locally (not over the network), because rsync does default to only copying changed blocks, but it overrides that default behav

Re: [zfs-discuss] Setting per-file record size / querying fs/file record size?

2008-12-01 Thread Roch
Bill Sommerfeld writes: > On Wed, 2008-10-22 at 10:30 +0100, Darren J Moffat wrote: > > I'm assuming this is local filesystem rather than ZFS backed NFS (which > > is what I have). > > Correct, on a laptop. > > > What has setting the 32KB recordsize done for the rest of your home > > di

Re: [zfs-discuss] Slow death-spiral with zfs gzip-9 compression

2008-12-01 Thread Roch
Tim writes: > On Sat, Nov 29, 2008 at 11:06 AM, Ray Clark <[EMAIL PROTECTED]>wrote: > > > Please help me understand what you mean. There is a big difference between > > being unacceptably slow and not working correctly, or between being > > unacceptably slow and having an implementation pro