Re: something about memory usage

2014-04-30 Thread wxhsdp
ser-list.1001560.n3.nabble.com/file/n5137/executor_threads.png> it's not accurate to use Runtime.getRuntime().freeMemory -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/something-about-memory-usage-tp5107p5137.html Sent from the Apache Spark User L

Re: something about memory usage

2014-04-30 Thread Daniel Darabos
On Wed, Apr 30, 2014 at 1:52 PM, wxhsdp wrote: > Hi, guys > > i want to do some optimizations of my spark codes. i use VisualVM to > monitor the executor when run the app. > here's the snapshot: > < > http://apache-spark-user-list.1001560.n3.nabble.com/file/n5107/executor.png > > > > from the

something about memory usage

2014-04-30 Thread wxhsdp
lly thought that 60% of the memory is kept for Spark's memory cache(i did not cache any RDDs in my application), so there was only 40% left for running the app. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/something-about-memory-usage-tp5107.html Sent