Re: Parallelizing a task makes it freeze

2014-08-12 Thread sparkuser2345
; executor 0: > > (PROCESS_LOCAL) > 14/08/11 18:17:32 INFO TaskSetManager: Serialized task 0.0:2 as 16154060 > bytes in 66 ms > > > dataAllRDD.map does work with smaller array though (e.g. nY = 100; > finishes in less than a second). >

Parallelizing a task makes it freeze

2014-08-11 Thread sparkuser2345
.map so much slower than dataAll.map, or even not executing at all? The Spark version I'm using is 0.9.0. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Parallelizing-a-task-makes-it-freeze-tp11900.html Sent