Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Will Murnane
On Thu, Jul 16, 2009 at 21:30, Rob Logan wrote: >> c4                             scsi-bus     connected    configured >> unknown >> c4::dsk/c4t15d0                disk         connected    configured >> unknown >  : >> c4::dsk/c4t33d0                disk         connected    configured >> unknown

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Will Murnane
On Thu, Jul 16, 2009 at 21:35, Adam Sherman wrote: > I'm looking at the LSI SAS3801X because it seems to be what Sun OEMs for my > X4100s: If you're given the choice (i.e., you have the M2 revision), PCI Express is probably the bus to go with. It's basically the same card, but on a faster bus. Bu

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
On 16-Jul-09, at 21:17 , Will Murnane wrote: Good to hear. What HBA(s) are you using against it? LSI 3442E-R. It's connected through a Supermicro cable, CBL-0168L, so it can be attached via an external cable. I'm looking at the LSI SAS3801X because it seems to be what Sun OEMs for my X4100

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Rob Logan
> c4 scsi-bus connectedconfigured unknown > c4::dsk/c4t15d0disk connectedconfigured unknown : > c4::dsk/c4t33d0disk connectedconfigured unknown > c4::es/ses0ESI connected

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Will Murnane
On Thu, Jul 16, 2009 at 21:16, Rob Logan wrote: > I'm confused, I though expanders only worked with SAS disk, and SATA disks > took an entire SAS port. could someone post an output showing more than 4 > SATA > drives across one InfiniBand cable (4 SAS ports) > > 2 % cfgadm | grep sata > sata1/0::ds

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Will Murnane
On Thu, Jul 16, 2009 at 20:20, Adam Sherman wrote: > Ever seen/read about anyone use this kind of setup for HA clustering? I'm > getting ideas about Open HA/Solaris Cluster on top of this setup with two > systems connecting, that would rock! It's possible that this would work with homogeneous hardw

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Rob Logan
>> We have a SC846E1 at work; it's the 24-disk, 4u version of the 826e1. >> It's working quite nicely as a SATA JBOD enclosure. > use the LSI SAS 3442e which also gives you an external SAS port. I'm confused, I though expanders only worked with SAS disk, and SATA disks took an entire SAS port. c

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Bob Friesenhahn
On Thu, 16 Jul 2009, Adam Sherman wrote: I should also ask: any other solutions I should have a look at to get >=12 SATA disks externally attached to my systems? Depending on how much failure resiliancy you want and how you plan to configure your pool, you may be better off with two independ

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
On 16-Jul-09, at 18:01 , Will Murnane wrote: We have a SC846E1 at work; it's the 24-disk, 4u version of the 826e1. It's working quite nicely as a SATA JBOD enclosure. We'll probably be buying another in the coming year to have more capacity. I should also ask: any other solutions I should hav

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
On 16-Jul-09, at 20:52 , James C. McPherson wrote: Another thought in the same vein, I notice many of these systems support "SES-2" for management. Does this do anything useful under Solaris? We've got some integration between FMA and SES devices which allows us to to some management tasks. S

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread James C. McPherson
On Thu, 16 Jul 2009 20:26:17 -0400 Adam Sherman wrote: > Another thought in the same vein, I notice many of these systems > support "SES-2" for management. Does this do anything useful under > Solaris? We've got some integration between FMA and SES devices which allows us to to some manageme

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Jonathan Borden
> > > We have a SC846E1 at work; it's the 24-disk, 4u > version of the 826e1. > > It's working quite nicely as a SATA JBOD enclosure. > We'll probably be > buying another in the coming year to have more > capacity. > Good to hear. What HBA(s) are you using against it? > I've got one too and it

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
Another thought in the same vein, I notice many of these systems support "SES-2" for management. Does this do anything useful under Solaris? Sorry for these questions, I seem to be having a tough time locating relevant information on the web. Thanks, A. -- Adam Sherman CTO, Versature Co

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
On 16-Jul-09, at 18:01 , Will Murnane wrote: The "direct attached" backplane is right out. This means that each drive has its own individual sata port, meaning you'd need three SAS wide ports just to connect the drives. The single-expander version has one LSI SAS expander, which connects to all

Re: [zfs-discuss] Solaris live CD that supports ZFS root mount for fs fixes

2009-07-16 Thread Peter Pickford
will boot -F failsafe work 2009/7/16 Matt Weatherford : > > Hi, > > I borked a libc.so library file on my solaris 10 server (zfs root) - was > wondering if there > is a good live CD that will be able to mount my ZFS root fs so that I can > make this > quick repair on the system boot drive and get

Re: [zfs-discuss] Solaris live CD that supports ZFS root mount for fs fixes

2009-07-16 Thread Jorgen Lundman
We used the OpenSolaris preview 2010.02 DVD on genunix.org, to fix our broken zboot after attempting to clone. It had the zpool and zfs tools enough to import, re-mount etc. Lund Matt Weatherford wrote: Hi, I borked a libc.so library file on my solaris 10 server (zfs root) - was wonderin

Re: [zfs-discuss] Solaris live CD that supports ZFS root mount for fs fixes

2009-07-16 Thread Ian Collins
Matt Weatherford wrote: Hi, I borked a libc.so library file on my solaris 10 server (zfs root) - was wondering if there is a good live CD that will be able to mount my ZFS root fs so that I can make this quick repair on the system boot drive and get back running again. Are all ZFS roots cre

[zfs-discuss] Solaris live CD that supports ZFS root mount for fs fixes

2009-07-16 Thread Matt Weatherford
Hi, I borked a libc.so library file on my solaris 10 server (zfs root) - was wondering if there is a good live CD that will be able to mount my ZFS root fs so that I can make this quick repair on the system boot drive and get back running again. Are all ZFS roots created equal? Its an x86 so

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Will Murnane
On Thu, Jul 16, 2009 at 17:02, Adam Sherman wrote: > Hello All, > > I'm just starting to think about building some mass-storage arrays and am > looking to better understand some of the components involved. > > For example, the Supermicro SC826 series of systems is available with three > backplanes:

[zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-16 Thread Adam Sherman
Hello All, I'm just starting to think about building some mass-storage arrays and am looking to better understand some of the components involved. For example, the Supermicro SC826 series of systems is available with three backplanes: 1. SAS / SATA Expander Backplane with single LSI SASX2

Re: [zfs-discuss] permission problem using ZFS send and zfs receive accross SSH

2009-07-16 Thread Ian Collins
Alexander Skwar wrote: Hi! On Thu, Jul 16, 2009 at 14:00, Cyril Ducrocq > wrote: moreover i added an "on the fly" compression using gzip You can dump the gzip|gunzip, if you use SSH on-the-fly compression, using ssh -C But test first, using compres

Re: [zfs-discuss] Why is Solaris 10 ZFS performance so terrible?

2009-07-16 Thread Bob Friesenhahn
I have received email that Sun CR numbers 6861397 & 6859997 have been created to get this performance problem fixed. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/

[zfs-discuss] ZFS pegging the system

2009-07-16 Thread Jeff Haferman
We have a SGE array task that we wish to run with elements 1-7. Each task generates output and takes roughly 20 seconds to 4 minutes of CPU time. We're doing them on a machine with about 144 8-core nodes, and we've divvied the job up to do about 500 at a time. So, we have 500 jobs at a t

Re: [zfs-discuss] Can't offline a RAID-Z2 device: "no valid replica"

2009-07-16 Thread Ross
Great news, thanks Tom! -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Why is Solaris 10 ZFS performance so terrible?

2009-07-16 Thread James Andrewartha
On Sun, 2009-07-12 at 16:38 -0500, Bob Friesenhahn wrote: > In order to raise visibility of this issue, I invite others to see if > they can reproduce it in their ZFS pools. The script at > > http://www.simplesystems.org/users/bfriesen/zfs-discuss/zfs-cache-test.ksh Here's the results from two

Re: [zfs-discuss] permission problem using ZFS send and zfs receive accross SSH

2009-07-16 Thread Cyril Ducrocq
Thanks for the tip in the meantime i had trouble with a cannot receive incremental stream: destination rpool/bck_sauvegardes_windows has been modified most recent snapshot ...i resolved isang the -F option of the ZFS RECV command (was only a modification of the atime property of the destinat

Re: [zfs-discuss] Can't offline a RAID-Z2 device: "no valid replica"

2009-07-16 Thread Thomas Liesner
FYI: In b117 it works as expected and stated in the documentation. Tom -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] permission problem using ZFS send and zfs receive accross SSH

2009-07-16 Thread Alexander Skwar
Hi! On Thu, Jul 16, 2009 at 14:00, Cyril Ducrocq wrote: > moreover i added an "on the fly" compression using gzip You can dump the gzip|gunzip, if you use SSH on-the-fly compression, using ssh -C ssh also uses gzip, so there won't be much difference. Regards, Alexander -- [[ http://zen

Re: [zfs-discuss] permission problem using ZFS send and zfs receive accross SSH

2009-07-16 Thread Cyril Ducrocq
i just found the solution ! i use pfexec to execute the ZFS receive command with the needed roles without beeing asked for a password. moreover i added an "on the fly" compression using gzip the solution looks like this zfs send rpool/sauvegardes_wind...@mercredi-16-07-09 | gzip| ssh re...@op

Re: [zfs-discuss] Can't offline a RAID-Z2 device: "no valid replica"

2009-07-16 Thread Thomas Liesner
You're right, from the documentation it definitely should work. Still, it doesn't. At least not in Solaris 10. But i am not a zfs-developer, so this should probably answered by them. I will give it a try with a recent OpneSolaris-VM and check, wether this works in newer implementations of zfs.

[zfs-discuss] permission problem using ZFS send and zfs receive accross SSH

2009-07-16 Thread Cyril Ducrocq
Hello i'm newbie on OpenSolaris and as i'm very interested in the ZFS functionalities in order to setup a disk-based replicated backup system for my company. I'm trying to bench it using 2 Virtual machines. ZFS snapshot commands work well on my main server as i've got the root "role" but i plann

Re: [zfs-discuss] Can't offline a RAID-Z2 device: "no valid replica"

2009-07-16 Thread Laurent Blume
> You could offline the disk if [b]this[/b] disk (not > the pool) had a replica. Nothing wrong with the > documentation. Hmm, maybe it is little misleading > here. I walked into the same "trap". I apologize for being daft here, but I don't find any ambiguity in the documentation. This is explicit