> On 4 Jun 2015, at 15:59, Chao Chen wrote:
>
> But when I try to run the Pagerank from HiBench, it always cause a node to
> reboot during the middle of the work for all scala, java, and python
> versions. But works fine
> with the MapReduce version from the same benchmark.
do you mean a rea
vm.swappiness=0? Some vendors recommend this set to 0 (zero), although I've
seen this causes even kernel to fail to allocate memory.
It may cause node reboot. If that's the case, set vm.swappiness to 5-10 and
decrease spark.*.memory. Your spark.driver.memory+
spark.executor.memory + OS + etc >> amo
