Re: spark and mesos issue

2014-09-15 Thread Gurvinder Singh
It might not be related only to memory issue. Memory issue is also there as you mentioned. I have seen that one too. The fine mode issue is mainly spark considering that it got two different block manager for same ID, whereas if I search for the ID in the mesos slave, it exist only on the one slave

Re: spark and mesos issue

2014-07-16 Thread Dario Rexin
Hi *, I already looked into this issue and created a PR that hopefully fixes the problem. Unfortunately I have not been able to reproduce the bug, but could track down a possible cause for this. See the PR for an explanation: https://github.com/apache/spark/pull/1358 If anyone who these experi

spark and mesos issue

2014-07-04 Thread Gurvinder Singh
We are getting this issue when we are running jobs with close to 1000 workers. Spark is from the github version and mesos is 0.19.0 ERROR storage.BlockManagerMasterActor: Got two different block manager registrations on 201407031041-1227224054-5050-24004-0 Googling about it seems that mesos is st