> Workloads: > > Mainly streaming compressed data. That is, pulling compressed data in > a sequential manner however could have multiple streams happening at > once making it somewhat random. We are hoping to have 5 clients pull > 500Mbit sustained.
That shouldn't be much of a problem with that amount of drives. I have a couple of smaller setups with 11x7-drive raidz2, about 100TiB each, and even they can handle 2,5Gbps load. > Considerations: > > The main reason RAIDZ3 was chosen was so we can distribute the parity > across the JBOD enclosures. With this method even if an entire JBOD > enclosure is taken offline the data is still accessible. Sounds like a good idea to me. > How to manage the physical locations of such a vast number of drives? > I have read this ( > http://blogs.oracle.com/eschrock/entry/external_storage_enclosures_in_solaris > ) and am hoping some can shed some light if the SES2 enclosure > identification has worked for them? (enclosures are SES2) Which enclosures will you be using? From the data you've posted, it looks like SuperMicro, and AFAIK, the ones we have, don't support SES2. > What kind of performance would you expect from this setup? I know we > can multiple the base IOPS by 24 but what about max sequential > read/write? Parallell read/write from several clients will look like random I/O on the server. If bandwidth is crucial, use RAID1+0. Also, it looks to me you're planning to fill up all external bays with data drives - where do you plan to put the root? If you're looking at the SuperMicro SC847 line, there's indeed room for a couple of 2,5" drives inside, but the chassis is screwed tightly together and doesn't allow for opening during runtime. Also, those drives are placed in a rather awkward slot. If planning to use RAIDz, a couple of SSDs for the SLOG will help write performance a lot especially during scrub/resilver. For streaming, L2ARC won't be of much use, though. Finally, a few spares won't hurt even with redundancy levels as high as RAIDz3. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
