Setting spark.mesos.coarse=true helped reduce the time on the mesos cluster
from 17 min to around 6 min. The scheduler delay per task reduced from 40
ms to around 10 ms.
thanks
On Mon, Sep 22, 2014 at 12:36 PM, Xiangrui Meng wrote:
> 1) MLlib 1.1 should be faster than 1.0 in general. What's th
I specified as follows:
spark.eventLog.dir /mapr/spark_io
We use mapr fs for sharing files. I did not provide an ip address or port
number - just the directory name on the shared filesystem.
On Aug 29, 2014 8:28 AM, "Brad Miller" wrote:
> How did you specify the HDFS path? When i put
>
> spark
