On Sat, Apr 30, 2016 at 2:55 PM, Adam Tygart wrote:
> Supposedly cephfs-hadoop worked and/or works on hadoop 2. I am in the
> process of getting it working with cdh5.7.0 (based on hadoop 2.6.0).
> I'm under the impression that it is/was working with 2.4.0 at some
> point in time.
>
> At this very
You can also have Hadoop talking to the Rados Gateway (SWIFT API) so
that the data is in Ceph instead of HDFS.
I wrote this tutorial that might help:
https://github.com/zioproto/hadoop-swift-tutorial
Saverio
2016-04-30 23:55 GMT+02:00 Adam Tygart :
> Supposedly cephfs-hadoop worked and/or works
Supposedly cephfs-hadoop worked and/or works on hadoop 2. I am in the
process of getting it working with cdh5.7.0 (based on hadoop 2.6.0).
I'm under the impression that it is/was working with 2.4.0 at some
point in time.
At this very moment, I can use all of the DFS tools built into hadoop
to crea
I think what you are thinking of is the driver that was built to actually
replace hdfs with rbd. As far as I know that thing had a very short
lifespan on one version of hadoop. Very sad.
As to what you proposed:
1) Don't use Cephfs in production pre-jewel.
2) running hdfs on top of ceph is a mas
Actually this guy is already a fan of Hadoop. I was just wondering
whether anyone has been playing around with it on top of cephfs lately.
It seems like the last round of papers were from around cuttlefish.
On 04/28/2016 06:21 AM, Oliver Dzombic wrote:
Hi,
bad idea :-)
Its of course nice a
Hi,
bad idea :-)
Its of course nice and important to drag developer towards a
new/promising technology/software.
But if the technology under the individual required specifications does
not match, you will just risk to show this developer how worst this
new/promising technology is.
So you will j
Just got into a discussion today where I may have a chance to do work
with a db guy who wants hadoop and I want to steer him to it on cephfs.
While I'd really like to run gentoo with either infernalis or jewel
(when it becomes stable in portage), odds are more likely that I will be
required to
