Re: Memory under-utilization

2014-09-16 Thread francisco
'local' mode the 'executor-memory' parameter is not honored. Thanks again for the help! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Memory-under-utilization-tp14396p14409.html Sent from the Apache Spark User List mailing list a

Re: Memory under-utilization

2014-09-16 Thread Boromir Widas
isk (671 times so far) > 14/09/16 15:00:43 WARN ExternalAppendOnlyMap: Spilling in-memory map of 67 > MB to disk (672 times so far) > ... > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Memory-under-utilization-tp14396p14399.html

Re: Memory under-utilization

2014-09-16 Thread francisco
lyMap: Spilling in-memory map of 67 MB to disk (672 times so far) ... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Memory-under-utilization-tp14396p14399.html Sent from the Apache Spark User List mailing list archive at Nabbl

Re: Memory under-utilization

2014-09-16 Thread Boromir Widas
> > Is there some limitation when running in 'local' mode? > > Thanks. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Memory-under-utilization-tp14396.html > Sent from the Apache Spark User List mailing list

Memory under-utilization

2014-09-16 Thread francisco
n when running in 'local' mode? Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Memory-under-utilization-tp14396.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --