Re: Last step of processing is using too much memory.

2014-07-29 Thread Davies Liu
e groupByKey. > I was simply using the default, which generated only 4 partitions and so the > whole thing blew up. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134p

Re: Last step of processing is using too much memory.

2014-07-18 Thread Roch Denis
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134p10147.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Last step of processing is using too much memory.

2014-07-17 Thread Roch Denis
gt; -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134.html Sent from the Apache Spark User List mailing list archive at Nabble.com.