I dont think its the controller card so much as I think its something to do with the disks/backplane/power management even. It works fine if I create raid volumes. if you wanted to be similar to Rich, you could just do a bunch of raid 0's with a perc 600. Using any type of raid with ZFS creates its own challenges in both performance tuning as well as recovery.
I would buy a 1U pizza box and a SAS HBA and JBOD.. In the past I had the 1078 chips connected to a AIC JBOD, never had issues, but then again it was solaris 10.. Made expansion super easy. I do miss my thumper still though :) Oracle says pretty clear that they dont support any type of expanders, funny cause the J45xx series are all expanders.. I will try the illumos lists again.. On Wed, Nov 30, 2011 at 5:13 PM, Geoff Flarity <geoff.flar...@gmail.com>wrote: > On Wed, Nov 30, 2011 at 5:02 PM, Andy Lubel <alu...@gmail.com> wrote: > > Yeah, and you are probably exporting each disk as a raid 0, pseudo jbod > > with some BBC.. I suppose that's an option for us but it > > really shouldn't be that way. The H200 can only create 2 raid disks > > anyways. > > > > Is there any other lists that may be of help? > > > > You might try the Illumos mailing list. I'm sure there's some nexenta > people watching that one. > > Eventually I'm going to try to install OI on an R410. I figure worst > case, maybe buy a different controller card? > > > > > On Wed, Nov 30, 2011 at 4:35 PM, Rich <rerc...@acm.jhu.edu> wrote: > > > >> I'm on a Dell R710 and haven't seen any such issues. > >> > >> Then again, I'm using a different controller than you are (PERC 6/i, > >> please don't ask me why). > >> > >> - Rich > >> > >> On Wed, Nov 30, 2011 at 4:17 PM, Andy Lubel <alu...@gmail.com> wrote: > >> > I have a feeling that my culprit here could be the disks: > ST2000NM0001. > >> > But its strange because again, everything works just fine in Solaris > 10, > >> > but in OI/Sol11 I get the errors. > >> > > >> > I have tried muddling with > >> > stmsboot -d > >> > /kernel/drv/scsi_vhci.conf > >> > /kernel/drv/mpt.conf > >> > /kernel/drv/mpt_sas.conf > >> > > >> > To no avail.. I'm working on getting new drives to try out, but it > still > >> > leaves some questions as to why this would work in solaris 10 and not > in > >> > the newer better IO/Sol11. Any further ideas would really help! > >> > > >> > link to drives (dell branded, latest FW): > >> > > >> > http://www.seagate.com/ww/v/index.jsp?name=st2000nm0001-constellation-es-sas-6gbs-2-tb-hd&vgnextoid=22eb82388ec0e210VgnVCM1000001a48090aRCRD&locale=en-US&pf=1 > >> > > >> > -Andy > >> > > >> > On Tue, Nov 22, 2011 at 5:33 PM, Andy Lubel <alu...@gmail.com> wrote: > >> > > >> >> Yep just an r510 with an h200 and 10x 2tb unraided/ 2x raided > internal > >> >> 146gb drives. What drives are you using in the front? Pure jbod with > >> Zfs? > >> >> > >> >> On Nov 22, 2011, at 17:03, Rich <rerc...@acm.jhu.edu> wrote: > >> >> > >> >> > Dell Rx10 works fine for me on S11. This is just the drives on the > >> >> > front, not an external MD1200 or similar, right? > >> >> > > >> >> > - Rich > >> >> > > >> >> > On Tue, Nov 22, 2011 at 4:30 PM, Andy Lubel <alu...@gmail.com> > wrote: > >> >> >> FYI solaris 10 works great but I really need dedup. Going to go > >> crazy > >> >> and > >> >> >> try to copy the kernel drivers from solaris 10 over to b151 and > see > >> what > >> >> >> happens. Saw a great article stating that expanders were not > >> supported > >> >> in > >> >> >> solaris 11.. so i wonder how they work the j series and HBA cards > >> that > >> >> are > >> >> >> only 8 ports.. > >> >> >> > >> >> >> On Mon, Nov 21, 2011 at 11:51 PM, Andy Lubel <alu...@gmail.com> > >> wrote: > >> >> >> > >> >> >>> So yeah an expander aka backplane in play here. What next? I > really > >> >> don't > >> >> >>> want to abandon the effort to hopefully use the best distribution > >> >> available > >> >> >>> for our needs. > >> >> >>> > >> >> >>> On Nov 18, 2011, at 16:22, "Jason J. W. Williams" < > >> >> >>> jasonjwwilli...@gmail.com> wrote: > >> >> >>> > >> >> >>>> If you've only got 2 ports on the LSI card for 12 drives, then > an > >> >> >>> expander > >> >> >>>> has to be in play. > >> >> >>>> > >> >> >>>> -J > >> >> >>>> > >> >> >>>> On Fri, Nov 18, 2011 at 2:15 PM, Andy Lubel <alu...@gmail.com> > >> wrote: > >> >> >>>> > >> >> >>>>> I'm betting there is an expander, it looks fancy and some > >> enclosure > >> >> >>> device > >> >> >>>>> shows up in the lsi firmware as well as cfgadm output.. Its > also > >> >> dual > >> >> >>>>> ported (and I have tried unplugging one cable with no different > >> >> >>> behavior). > >> >> >>>>> I may or may not be able to test these drives in another > system.. > >> >> let me > >> >> >>>>> try some shuffling and I will report my findings. I knew this > >> R510 > >> >> was > >> >> >>>>> going to be a challenge, but I didn't think for the backplane.. > >> >> >>>>> > >> >> >>>>> On Fri, Nov 18, 2011 at 4:09 PM, Jason J. W. Williams < > >> >> >>>>> jasonjwwilli...@gmail.com> wrote: > >> >> >>>>> > >> >> >>>>>> On Fri, Nov 18, 2011 at 1:59 PM, Andy Lubel <alu...@gmail.com > > > >> >> wrote: > >> >> >>>>>> > >> >> >>>>>>> IT firmware didn't work, same issue. I am really leaning > >> towards > >> >> some > >> >> >>>>>> sort > >> >> >>>>>>> of enclosure problem (backplane) - any ideas how to > troubleshoot > >> >> that? > >> >> >>>>>>> > >> >> >>>>>> > >> >> >>>>>> Do the 2TB 2.5" drives work in other systems? Have you tried > >> other > >> >> >>> drives > >> >> >>>>>> you might have lying around to narrow it down to just the 2TB > >> >> drives? > >> >> >>> Are > >> >> >>>>>> there SAS expanders in the backplane? > >> >> >>>>>> > >> >> >>>>>> -J > >> >> >>>>>> _______________________________________________ > >> >> >>>>>> OpenIndiana-discuss mailing list > >> >> >>>>>> OpenIndiana-discuss@openindiana.org > >> >> >>>>>> http://openindiana.org/mailman/listinfo/openindiana-discuss > >> >> >>>>>> > >> >> >>>>> _______________________________________________ > >> >> >>>>> OpenIndiana-discuss mailing list > >> >> >>>>> OpenIndiana-discuss@openindiana.org > >> >> >>>>> http://openindiana.org/mailman/listinfo/openindiana-discuss > >> >> >>>>> > >> >> >>>> _______________________________________________ > >> >> >>>> OpenIndiana-discuss mailing list > >> >> >>>> OpenIndiana-discuss@openindiana.org > >> >> >>>> http://openindiana.org/mailman/listinfo/openindiana-discuss > >> >> >>> > >> >> >> _______________________________________________ > >> >> >> OpenIndiana-discuss mailing list > >> >> >> OpenIndiana-discuss@openindiana.org > >> >> >> http://openindiana.org/mailman/listinfo/openindiana-discuss > >> >> >> > >> >> > > >> >> > _______________________________________________ > >> >> > OpenIndiana-discuss mailing list > >> >> > OpenIndiana-discuss@openindiana.org > >> >> > http://openindiana.org/mailman/listinfo/openindiana-discuss > >> >> > >> > _______________________________________________ > >> > OpenIndiana-discuss mailing list > >> > OpenIndiana-discuss@openindiana.org > >> > http://openindiana.org/mailman/listinfo/openindiana-discuss > >> > >> _______________________________________________ > >> OpenIndiana-discuss mailing list > >> OpenIndiana-discuss@openindiana.org > >> http://openindiana.org/mailman/listinfo/openindiana-discuss > >> > > _______________________________________________ > > OpenIndiana-discuss mailing list > > OpenIndiana-discuss@openindiana.org > > http://openindiana.org/mailman/listinfo/openindiana-discuss > > _______________________________________________ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss > _______________________________________________ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
