Re: [zfs-discuss] Hardware Raid Vs ZFS implementation on Su n X4150/X4450

Aaron Blew gmail.com> writes: > > I've done some basic testing with a X4150 machine using 6 disks in a > RAID 5 and RAID Z configuration.  They perform very similarly, but RAIDZ > definitely has more system overhead. Since hardware RAID 5 implementations usually do not checksum data (they only

[zfs-discuss] help diagnosing system hang

Hi all, First, I'll say my intent is not to spam a bunch of lists, but after posting to opensolaris-discuss I had someone communicate with me offline that these lists would possibly be a better place to start. So here we are. For those on all three lists, sorry for the repetition. Second, thi

Re: [zfs-discuss] zfs boot - U6 kernel patch breaks sparc boot

On Tue, Dec 02, 2008 at 12:22:49PM -0800, Vincent Fox wrote: > Reviving this thread. > > We have a Solaris 10u4 system recently patched with 137137-09. > Unfortunately the patch was applied from multi-user mode, I wonder if this > may have been original posters problem as well? Anyhow we are now

[zfs-discuss] zpool "cannot replace a replacing device"

I have a 10 drive raidz, recently one of the disks appeared to be generating errors (this later turned out to be a cable), I removed the disk from the array, ran vendor diagnostics (which zeroed it). Upon reinstalling the disk however zfs will not resilver it, it gets referred to numerically in

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Thanks Max and Chris. I don't really want the problem to occur again, of course, but I'll be prepared if it does. On Wed, Dec 3, 2008 at 6:46 PM, Chris Siebenmann <[EMAIL PROTECTED]> wrote: > You write: > | > If keyboard input is not getting in, your machine is probably wedged > | > at a high le

Re: [zfs-discuss] zpool replace - choke point

I think we found the choke point. The silver lining is that it isn't the T2000 or ZFS. We think it is the new SAN, an Hitachi AMS1000, which has 7200RPM SATA disks with the cache turned off. This system has a very small cache, and when we did turn it on for one of the replacement LUNs we saw

Re: [zfs-discuss] zfs free space

Even if that maximum number of shared collections is that much, I think the information should be available if requested, even if it becomes similar to a 'scrub' operation in terms of the time taken. For a filesystem like mine that only has 10 or so snapshots, I'd really only expect 3 or 4 of th

Re: [zfs-discuss] OpenSolaris vs Linux

Joseph Zhou wrote: > Thanks Ian, Tim, > Ok, let me really hit one topic instead of trying to see in general > what data are out there... > > Let's say OpenSolaris doing Samba vs. Linux doing Samba, in CIFS > performance. > (so I can link to the Win2008 CIFS numbers and NetApp CIFS numbers > myself.

Re: [zfs-discuss] OpenSolaris vs Linux

On Wed, Dec 3, 2008 at 4:15 PM, Joseph Zhou <[EMAIL PROTECTED]>wrote: > haha, Tim, yes, I see the Open spirit in this reply! ;-) > > As I said, I am just exploring data. > > The Sun J4000 SPC1 and SPC2 benchmark results were nice, just lacking other > published results with the iSCSI HBA as DAS

Re: [zfs-discuss] Availability: ZFS needs to handle disk removal / driver failure better

> "r" == Ross <[EMAIL PROTECTED]> writes: rs> I don't think it likes it if the iscsi targets aren't rs> available during boot. from my cheatsheet: -8<- ok boot -m milestone=none [boots. enter root password for maintenance.] bash-3.00# /sbin/mount -o remount,rw / [<-- otherw

Re: [zfs-discuss] OpenSolaris vs Linux

haha, Tim, yes, I see the Open spirit in this reply! ;-) As I said, I am just exploring data. The Sun J4000 SPC1 and SPC2 benchmark results were nice, just lacking other published results with the iSCSI HBA as DAS, not as a network storage device (as 7000). Though I would attempt to say thos

Re: [zfs-discuss] zfs free space

> "n" == none <[EMAIL PROTECTED]> writes: > "rm" == Robert Milkowski <[EMAIL PROTECTED]> writes: n> eg, n> zfs list-shared n> SHARED COLLECTIONUSED n> (storage/fs, storage/[EMAIL PROTECTED], storage/[EMAIL PROTECTED]) 100G

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Hi Blake, Blake Irvin wrote: > I am directly on the console. cde-login is disabled, so i'm dealing > with direct entry. > >>Are you directly on the console, or is the console on >> a serial port? If you are >> running over X windows, the input might still get in, >> but X may not be displ

Re: [zfs-discuss] zfs free space

Hi Milek, I specifically don't want to destroy the oldest snapshot because I already know it won't free up much disk space, since it is sharing most data with the current fs. If I delete it I will have lost any old data which might be needed for recovery (eg. if I accidentally corrupt some files

Re: [zfs-discuss] OpenSolaris vs Linux

On Wed, Dec 3, 2008 at 3:51 PM, Joseph Zhou <[EMAIL PROTECTED]>wrote: > Ok, thanks Tim, which SPC are you talking about? > > SPC-1 and SPC-2 don't test NAS, those are block perf. > SPECsfs97 v2/v3 and sfs2008 have no OpenStorage results. > > If there are standard storage benchmarks out there, I w

Re: [zfs-discuss] OpenSolaris vs Linux

Ok, thanks Tim, which SPC are you talking about? SPC-1 and SPC-2 don't test NAS, those are block perf. SPECsfs97 v2/v3 and sfs2008 have no OpenStorage results. If there are standard storage benchmarks out there, I would not be here asking folks. To your point, how is the OpenSolaris native C

Re: [zfs-discuss] zfs free space

Hello none, Wednesday, December 3, 2008, 8:38:03 PM, you wrote: n> Hi Sanjeev and Milek, thanks for your replies but I'm afraid they are somewhat missing the point. n> I have a situation (and I believe it would be fairly common) where n> early snapshots would be sharing most data with the curren

Re: [zfs-discuss] zfs free space

To provide a complete (meaning it is currently incomplete) disk usage report, I think zfs would need provide the following: Each block in a zfs fs in general is shared by one or more of either the current fs or snapshots. Call this the block's "share set". Eg, (storage/fs, storage/[EMAIL PROTECT

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

I am directly on the console. cde-login is disabled, so i'm dealing with direct entry. > > Are you directly on the console, or is the console on > a serial port? If > you are > running over X windows, the input might still get in, > but X may not be > displaying. > If keyboard input is not

Re: [zfs-discuss] OpenSolaris vs Linux

On Wed, Dec 3, 2008 at 3:36 PM, Joseph Zhou <[EMAIL PROTECTED]>wrote: > Thanks Ian, Tim, > Ok, let me really hit one topic instead of trying to see in general what > data are out there... > > Let's say OpenSolaris doing Samba vs. Linux doing Samba, in CIFS > performance. > (so I can link to the Wi

Re: [zfs-discuss] OpenSolaris vs Linux

Thanks Ian, Tim, Ok, let me really hit one topic instead of trying to see in general what data are out there... Let's say OpenSolaris doing Samba vs. Linux doing Samba, in CIFS performance. (so I can link to the Win2008 CIFS numbers and NetApp CIFS numbers myself.) Is there any data to this spe

Re: [zfs-discuss] OpenSolaris vs Linux

On Wed, Dec 3, 2008 at 3:11 PM, Joseph Zhou <[EMAIL PROTECTED]>wrote: > Thanks Tim, > At this moment, I am looking into OpenStorage as NAS (file serving) vs. > Linux NAS (Samba) vs. Win2008 NAS vs. NetApp (ONTAP, not GX) performance. > > I am also interested in block-based performance, but not as

Re: [zfs-discuss] OpenSolaris vs Linux

Joseph Zhou wrote: > Thanks Tim, > At this moment, I am looking into OpenStorage as NAS (file serving) > vs. Linux NAS (Samba) vs. Win2008 NAS vs. NetApp (ONTAP, not GX) > performance. > There are still a number of ZFS/OpenSOlaris options to compare, iSCSI, Samba, CIFS, NFS. -- Ian. __

Re: [zfs-discuss] OpenSolaris vs Linux

Thanks Tim, At this moment, I am looking into OpenStorage as NAS (file serving) vs. Linux NAS (Samba) vs. Win2008 NAS vs. NetApp (ONTAP, not GX) performance. I am also interested in block-based performance, but not as urgent as above. (Since 7000 is mainly doing NAS today, in a non-HPC-clustered

Re: [zfs-discuss] OpenSolaris vs Linux

On Wed, Dec 3, 2008 at 2:39 PM, Joseph Zhou <[EMAIL PROTECTED]>wrote: > Hi list, > > Any one has ANY new data on OpenSolaris vs Linux? > > I only found an old post in 2006. > http://mail.opensolaris.org/pipermail/zfs-discuss/2006-January/030366.html > > And any comments on "if OpenSolaris perform

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Hi Blake, Blake Irvin wrote: > Thanks - however, the machine hangs and doesn't even accept console input > when this occurs. I can't get into the kernel debugger in these cases. > Are you directly on the console, or is the console on a serial port? If you are running over X windows, the inp

[zfs-discuss] OpenSolaris vs Linux

Hi list, Any one has ANY new data on OpenSolaris vs Linux? I only found an old post in 2006. http://mail.opensolaris.org/pipermail/zfs-discuss/2006-January/030366.html And any comments on "if OpenSolaris performance is about the same as Solaris 10"? Thanks! z___

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Thanks - however, the machine hangs and doesn't even accept console input when this occurs. I can't get into the kernel debugger in these cases. I've enabled the deadman timer instead. I'm also using the automatic snapshot service to get a look at things like /var/adm/sa/sa** files that get o

Re: [zfs-discuss] zfs free space

Hi Sanjeev and Milek, thanks for your replies but I'm afraid they are somewhat missing the point. I have a situation (and I believe it would be fairly common) where early snapshots would be sharing most data with the current filesystem and more recent snapshots are holding onto data that has bee

Re: [zfs-discuss] Availability: ZFS needs to handle disk removal / driver failure better

Yeah, thanks Maurice, I just saw that one this afternoon. I guess you can't reboot with iscsi full stop... o_0 And I've seen the iscsi bug before (I was just too lazy to look it up lol), I've been complaining about that since February. In fact it's been a bad week for iscsi here, I've managed to

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Hi Blake, Blake Irvin wrote: > I'm having a very similar issue. Just updated to 10 u6 and upgrade my > zpools. They are fine (all 3-way mirors), but I've lost the machine around > 12:30am two nights in a row. > > > What I'd really like is a way to force a core dump when the machine hangs > li

Re: [zfs-discuss] Availability: ZFS needs to handle disk removal / driver failure better

>2. With iscsi, you can't reboot with sendtargets enabled, static >discovery still seems to be the order of the day. I'm seeing this problem with static discovery: http://bugs.opensolaris.org/view_bug.do?bug_id=6775008. >4. iSCSI still has a 3 minute timeout, during which time your pool >wil

Re: [zfs-discuss] zfs boot - U6 kernel patch breaks sparc boot

Followup to my own post. Looks like my SVM setup was having problems prior to patch being applied. If I boot net:dhcp -s and poke around on the disks, it looks like disk0 is pre-patch state and disk1 is post-patch. I can get a shell if I boot disk1 -s So I think I am in SVM hell here not specfic

[zfs-discuss] Flash Archive Support for ZFS?

zfs-discuss, Now that we've finally got support for ZFS root filesystems on Solaris 10, I was wondering if anyone knows what the status is for ZFS Flash Archive. Presumably it's got to use ZFS send/receive functionality, but is rolling that into FlashArchive something that's on the roadmap? Thank

Re: [zfs-discuss] zfs_nocacheflush, nvram, and root pools

On 12/02/08 03:47, River Tarnell wrote: > hi, > > i have a system connected to an external DAS (SCSI) array, using ZFS. the > array has an nvram write cache, but it honours SCSI cache flush commands by > flushing the nvram to disk. the array has no way to disable this behaviour. > a > well-kno

Re: [zfs-discuss] Hardware Raid Vs ZFS implementation on Sun X4150/X4450

I've done some basic testing with a X4150 machine using 6 disks in a RAID 5 and RAID Z configuration. They perform very similarly, but RAIDZ definitely has more system overhead. In many cases this won't be a big deal, but if you need as many CPU cycles as you can muster, hardware RAID may be your

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

I think my problem is actually different - I'm not using iSCSI at all. I will update if I find otherwise. And yes, I do think there is support available for OpenSolaris now: Blake On Wed, Dec 3, 2008 at 9:32 AM, Tim <[EMAIL PROTECTED]> wrote: >

Re: [zfs-discuss] Availability: ZFS needs to handle disk removal / driver failure better

Ok, I've done some more testing today and I almost don't know where to start. I'll begin with the good news for Miles :) - Rebooting doesn't appear to cause ZFS to loose the resilver status (but see 1. below) - Resilvering appears to work fine, once complete I never saw any checksum errors when

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

On Wed, Dec 3, 2008 at 7:49 AM, Jacob Ritorto <[EMAIL PROTECTED]>wrote: > Update: It would appear that the bug I was complaining about nearly a > year ago is still at play here: > http://opensolaris.org/jive/thread.jspa?threadID=49372&tstart=0 > > Unfortunate Solution: Ditch Solaris 10 and run N

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

Update: It would appear that the bug I was complaining about nearly a year ago is still at play here: http://opensolaris.org/jive/thread.jspa?threadID=49372&tstart=0 Unfortunate Solution: Ditch Solaris 10 and run Nevada. The nice folks in the OpenSolaris project fixed the problem a long tim

Re: [zfs-discuss] How to diagnose zfs - iscsi - nfs hang

I'm having a very similar issue. Just updated to 10 u6 and upgrade my zpools. They are fine (all 3-way mirors), but I've lost the machine around 12:30am two nights in a row. I'm booting ZFS root pools, if that makes any difference. I also don't see anything in dmesg, nothing on the console ei

Re: [zfs-discuss] Asymmetric zpool load

Carsten Aulbert wrote: > Put some stress on the system with bonnie and other tools and try to > find slow disks and see if this could be the main problem but also look > into more vdevs and then possible move to raidz to somehow compensate > for lost disk space. Since we have 4 cold spares on the

Re: [zfs-discuss] zfs free space

Hello Sanjeev, Wednesday, December 3, 2008, 5:20:47 AM, you wrote: S> Hi, S> A good rough estimate would be the total of the space S> that is displayed under the "USED" column of "zfs list" for those snapshots. S> Here is an example : S> -- snip -- S> [EMAIL PROTECTED] zfs list -r tank S> NAME

Re: [zfs-discuss] Asymmetric zpool load

Carsten Aulbert aei.mpg.de> writes: > > Put some stress on the system with bonnie and other tools and try to > find slow disks Just run "iostat -Mnx 2" (not zpool iostat) while ls is slow to find the slow disks. Look at the %b (busy) values. -marc _

Re: [zfs-discuss] Asymmetric zpool load

Ross wrote: > Aha, found it! It was this thread, also started by Carsten :) > http://www.opensolaris.org/jive/thread.jspa?threadID=78921&tstart=45 Did I? Darn, I need to get a brain upgrade. But yes, there it was mainly focused on zfs send/receive being slow - but maybe these are also linked. W