I ended up destroying the EC pool and starting over. It was killing all of my OSD machines, and I couldn't keep anything working right with EC in use. So, no core dumps and I'm not in a place to reproduce easily anymore. This was with Giant on Ubuntu 14.04.
On Thu Feb 12 2015 at 7:07:38 AM Mark Nelson <mnel...@redhat.com> wrote: > On 02/08/2015 10:41 PM, Scott Laird wrote: > > Does anyone have a good recommendation for per-OSD memory for EC? My EC > > test blew up in my face when my OSDs suddenly spiked to 10+ GB per OSD > > process as soon as any reconstruction was needed. Which (of course) > > caused OSDs to OOM, which meant more reconstruction, which fairly > > immediately led to a dead cluster. This was with Giant. Is this > typical? > > Doh, that shouldn't happen. Can you reproduce it? Would be especially > nice if we could get a core dump or if you could make it happen under > valgrind. If the CPUs are spinning, even a perf report might prove useful. > > > > > On Fri Feb 06 2015 at 2:41:50 AM Mohamed Pakkeer <mdfakk...@gmail.com > > <mailto:mdfakk...@gmail.com>> wrote: > > > > Hi all, > > > > We are building EC cluster with cache tier for CephFS. We are > > planning to use the following 1U chassis along with Intel SSD DC > > S3700 for cache tier. It has 10 * 2.5" slots. Could you recommend a > > suitable Intel processor and amount of RAM to cater 10 * SSDs?. > > > > http://www.supermicro.com/products/system/1U/1028/SYS-1028R-WTRT.cfm > > > > > > Regards > > > > K.Mohamed Pakkeer > > > > > > > > On Fri, Feb 6, 2015 at 2:57 PM, Stephan Seitz > > <s.se...@heinlein-support.de <mailto:s.se...@heinlein-support.de>> > > wrote: > > > > Hi, > > > > Am Dienstag, den 03.02.2015, 15:16 +0000 schrieb Colombo Marco: > > > Hi all, > > > I have to build a new Ceph storage cluster, after i‘ve read > the > > > hardware recommendations and some mail from this mailing list > i would > > > like to buy these servers: > > > > just FYI: > > > > SuperMicro already focuses on ceph with a productline: > > http://www.supermicro.com/solutions/datasheet_Ceph.pdf > > http://www.supermicro.com/solutions/storage_ceph.cfm > > > > > > > > regards, > > > > > > Stephan Seitz > > > > -- > > > > Heinlein Support GmbH > > Schwedter Str. 8/9b, 10119 Berlin > > > > http://www.heinlein-support.de > > > > Tel: 030 / 405051-44 > > Fax: 030 / 405051-19 > > > > Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht > > Berlin-Charlottenburg, > > Geschäftsführer: Peer Heinlein -- Sitz: Berlin > > > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > > > > > > -- > > Thanks & Regards > > K.Mohamed Pakkeer > > Mobile- 0091-8754410114 > > > > _________________________________________________ > > ceph-users mailing list > > ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > > http://lists.ceph.com/__listinfo.cgi/ceph-users-ceph.__com > > <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> > > > > > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com