Re: Error while running SparkPi in Hadoop HA

2015-04-21 Thread Fernando O.
Solved Looks like it's some incompatibility in the build when using -Phadoop-2.4 , made the distribution with -Phadoop-provided and that fixed the issue On Tue, Apr 21, 2015 at 2:03 PM, Fernando O. wrote: > Hi all, > > I'm wondering if SparkPi works with hadoop HA (I guess it should) > >

Error while running SparkPi in Hadoop HA

2015-04-21 Thread Fernando O.
Hi all, I'm wondering if SparkPi works with hadoop HA (I guess it should) Hadoop's pi example works great on my cluster, so after having that done I installed spark and in the worker log I'm seeing two problems that might be related. Versions: Hadoop 2.6.0 Spark 1.3.1 I'm runn