Hi all,
(Waking up an old thread just for future reference)
We've had a very similar issue just a couple of days ago: executing a spark
driver on the same host as where the mesos master runs succeeds, but
executing it on our remote dev station hangs fails after mesos report the
spark driver dis
<https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala>)*
S
On Fri, Sep 26, 2014 at 3:09 PM, Svend Vanderveken <
svend.vanderve...@gmail.com> wrote:
> Hi all,
>
> I apologise for re-po
n would be greatly appreciated.
"
On Thu, Sep 25, 2014 at 4:20 PM, Svend wrote:
> I experience spark streaming restart issues similar to what is discussed in
> the 2 threads below (in which I failed to find a solution). Could anybody
> let me know if anything is wrong in the way I s
I experience spark streaming restart issues similar to what is discussed in
the 2 threads below (in which I failed to find a solution). Could anybody
let me know if anything is wrong in the way I start/stop or if this could be
a spark bug?
http://apache-spark-user-list.1001560.n3.nabble.com/RDD-da
As suggested, I opened this Jira:
https://issues.apache.org/jira/browse/SPARK-2576
S
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/ClassNotFoundException-line11-read-when-loading-an-HDFS-text-file-with-SparkQL-in-spark-shell-tp9954p10155.html
Sent from
Hi,
Yes, the error still occurs when we replace the lambdas with named
functions:
(same error traces as in previous posts)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/ClassNotFoundException-line11-read-when-loading-an-HDFS-text-file-with-SparkQL-i
Hi Victor,
I have the same issue (and no solution, unfortunately... )
I mentioned it in another post => keep an eye on that one in case some
future reply there could help you:
http://apache-spark-user-list.1001560.n3.nabble.com/ClassNotFoundException-line11-read-when-loading-an-HDFS-text-fil
Hi Michael,
Thanks for your reply. Yes, the reduce triggered the actual execution, I got
a total length (totalLength: 95068762, for the record).
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/ClassNotFoundException-line11-read-when-loading-an-HDFS-text
same installation works fine:
The hdfs files contain just plain csv files:
spark-env.sh look like this:
Any help, comment or pointer would be greatly appreciated!
Thanks in advance
Svend
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com
