Stefan G. Weichinger <lists <at> xunil.at> writes:
> > Though this was a year ago or so. Your mileage may vary and it is > > likely that during this year stability was improved. Ceph is very > > promising by both design and capabilities. > I expect that there were many changes over the time of a year ... they > went from v0.72 (5th stable release) in Nov 2013 to v0.80 in May 2014 > (6th stable release) ... and v0.87 in Oct 2014 (7th ...) > We get 0.80.7 in ~amd64 now ... I will see. > Ad "slow": what kind of hardware did you use and how many nodes/osds? I too am building up a (3 node) cluster on btrfs/ceph. My hardware is AMD 8350 (8 cores) with 32G of ram on each mobo. I have water coolers installed and intend to crank up to 6GHz after the cluster is stable. My work has been idle for about a month due to other, more pressing, needs. My cluster will be openrc centric, many others are systemd centric. ymmv. I intend to run mesos+spark to keep some codes "in-memory" and thus only write out to HD, when large jobs are finished. Here is the lab that is pushing the state of the art on "in-memory" computations [1]. Spark is now managed under the Apache umbrella of projects. I believe that most of the current problems folks encounter with btrfs+ceph, are related to the need to tune the underlying linux kernels with advanced tools and testing [2]. I think there is an ebuild (don't remember where) that puts trace-cmd, ftrace and kernel shark into a gentoo gui package. I opened a bug on BGO (Bug 517428), but so far it is still in search of a maintainer. I hope an active group of gentoo-clustering emerges after the herds/projects at gentoo are re-organized. The science herd/project is your best bet for folks with similar interests in gentoo clusters, imho [3]. hth, James [1] https://amplab.cs.berkeley.edu/ [2] http://lwn.net/Articles/425583/ [3] http://wiki.gentoo.org/wiki/Project:Science/Overlay