RDD's can't be serialized.
Therefore you are receiving the NullPointerException. Try joining the RDDs
based on `event` and then filter based on that.
Best,
Burak
- Original Message -
From: "Blackeye"
To: u...@spark.incubator.apache.org
Sent: Tuesday, September 9, 2014 3:34:
You should not be broadcasting an RDD. You also should not be passing an
RDD in a lambda to another RDD. If you want, can call RDD.collect and then
broadcast those values (of course you must be able to fit all those values
in memory).
On Tue, Sep 9, 2014 at 6:34 AM, Blackeye wrote:
> In order to
In order to help anyone to answer i could say that i checked the
inactiveIDs.filter operation seperated, and I found that it doesn't return
null in any case. In addition i don't how to handle (or check) whether a RDD
is null. I find the debugging to complicated to point the error. Any ideas
how to
