Yes, only when using fine grained mode and replication
(StorageLevel.MEMORY_ONLY_2
etc).
2015-03-27 19:06 GMT+01:00 Tathagata Das :
> Does it fail with just Spark jobs (using storage levels) on non-coarse
> mode?
>
> TD
>
> On Fri, Mar 27, 2015 at 4:39 AM, Ondrej Smola
>
More info
when using *spark.mesos.coarse* everything works as expected. I think this
must be a bug in spark-mesos integration.
2015-03-27 9:23 GMT+01:00 Ondrej Smola :
> It happens only when StorageLevel is used with 1 replica ( StorageLevel.
> MEMORY_ONLY_2,StorageLevel.MEMORY_AND_
r 26, 2015 at 2:08 PM, Ondrej Smola
> wrote:
>
>> Hi thanks for reply,
>>
>> yes I have custom receiver -> but it has simple logic .. pop ids from
>> redis queue -> load docs based on ids from elastic and store them in spark.
>> No classloader modifications
