RE: No FileSystem for scheme: hdfs

2014-07-04 Thread Steven Cox
configuration files (present in conf/*.xml).​ Thanks Best Regards On Fri, Jul 4, 2014 at 7:38 AM, Steven Cox mailto:s...@renci.org>> wrote: They weren't. They are now and the logs look a bit better - like perhaps some serialization is completing that wasn't before. But I still ge

RE: No FileSystem for scheme: hdfs

2014-07-03 Thread Steven Cox
2014 9:54 PM To: user@spark.apache.org Subject: Re: No FileSystem for scheme: hdfs Are the hadoop configuration files on the classpath for your mesos executors? On Thu, Jul 3, 2014 at 6:45 PM, Steven Cox mailto:s...@renci.org>> wrote: ...and a real subject line. _

No FileSystem for scheme: hdfs

2014-07-03 Thread Steven Cox
...and a real subject line. From: Steven Cox [s...@renci.org] Sent: Thursday, July 03, 2014 9:21 PM To: user@spark.apache.org Subject: Folks, I have a program derived from the Kafka streaming wordcount example which works fine standalone. Running on Mesos is

[no subject]

2014-07-03 Thread Steven Cox
Folks, I have a program derived from the Kafka streaming wordcount example which works fine standalone. Running on Mesos is not working so well. For starters, I get the error below "No FileSystem for scheme: hdfs". I've looked at lots of promising comments on this issue so now I have - * Eve

RE: Spark 0.9.1 core dumps on Mesos 0.18.0

2014-04-17 Thread Steven Cox
exact same version that Sean used (1.7.0_51) ? Maybe it was a bug fixed in 51 and a regression has been introduced in 55 :-D Andy On Thu, Apr 17, 2014 at 9:36 PM, Steven Cox mailto:s...@renci.org>> wrote: FYI, I've tried older versions (jdk6.x), openjdk. Also here's a fresh co

RE: Spark 0.9.1 core dumps on Mesos 0.18.0

2014-04-17 Thread Steven Cox
the JVM with simple version incompatibilities :) -- Sean Owen | Director, Data Science | London On Thu, Apr 17, 2014 at 7:29 PM, Steven Cox mailto:s...@renci.org>> wrote: > So I tried a fix found on the list... > >"The issue was due to meos version mismatch as I am using l

Spark 0.9.1 core dumps on Mesos 0.18.0

2014-04-17 Thread Steven Cox
So I tried a fix found on the list... "The issue was due to meos version mismatch as I am using latest mesos 0.17.0, but spark uses 0.13.0. Fixed by updating the SparkBuild.scala to latest version." I changed this line in SparkBuild.scala "org.apache.mesos" % "mesos"