Stefan G. Weichinger <lists <at> xunil.at> writes:

> > Though this was a year ago or so. Your mileage may vary and it is
> > likely that during this year stability was improved. Ceph is very
> > promising by both design and capabilities.

> I expect that there were many changes over the time of a year ... they
> went from v0.72 (5th stable release) in Nov 2013 to v0.80 in May 2014
> (6th stable release) ... and v0.87 in Oct 2014 (7th ...)
> We get 0.80.7 in ~amd64 now ... I will see.
> Ad "slow": what kind of hardware did you use and how many nodes/osds?

I too am building up a (3 node) cluster on btrfs/ceph. 
My hardware is AMD 8350 (8 cores) with 32G of ram on each mobo. I have water
coolers installed and intend to crank up to 6GHz after the cluster is
stable. My work has been idle for about a month due to other, more pressing,
needs. My cluster will be openrc centric, many others are systemd centric. ymmv.

I intend to run mesos+spark to keep some codes "in-memory" and thus
only write out to HD, when large jobs are finished. Here is the lab
that is pushing the state of the art on "in-memory" computations [1].
Spark is now managed under the Apache umbrella of projects.

I believe that most of the current problems folks encounter with btrfs+ceph,
are related to the need to tune the underlying linux
kernels with advanced tools and testing [2].

I think there is an ebuild (don't remember where) that puts trace-cmd,
ftrace and kernel shark into a gentoo gui package. I opened a bug on
BGO (Bug 517428), but so far it is still in search of a maintainer.


I hope an active group of gentoo-clustering emerges after the herds/projects
at gentoo are re-organized. The science herd/project
is your best bet for folks with similar interests in gentoo clusters,
 imho [3].


hth,
James


[1] https://amplab.cs.berkeley.edu/

[2] http://lwn.net/Articles/425583/

[3] http://wiki.gentoo.org/wiki/Project:Science/Overlay




Reply via email to