Re: Caching issue with msg: RDD block could not be dropped from memory as it does not exist

2014-07-25 Thread Rico
ttp://spark.apache.org/docs/latest/tuning.html#determining-memory-consumption> . -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Caching-issue-with-msg-RDD-block-could-not-be-dropped-from-memory-as-it-does-not-exist-tp10248p10677.html Sent from the Apache Spark Use

Re: Caching issue with msg: RDD block could not be dropped from memory as it does not exist

2014-07-22 Thread rindra
ith-msg-RDD-block-could-not-be-dropped-from-memory-as-it-does-not-exist-tp10248.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> > > > > ------------------ > If you reply to this email, your message will be added to the di

Re: Caching issue with msg: RDD block could not be dropped from memory as it does not exist

2014-07-21 Thread Andrew Or
is only 13MB with 100 partitions size. > > How to prevent this caching issue from happening? Thanks. > > Rindra > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Caching-issue-with-msg-RDD-block-could-not-be-dropped-from-memory-as-it-does-not-exist-tp10248.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Caching issue with msg: RDD block could not be dropped from memory as it does not exist

2014-07-19 Thread rindra
apache-spark-user-list.1001560.n3.nabble.com/Caching-issue-with-msg-RDD-block-could-not-be-dropped-from-memory-as-it-does-not-exist-tp10248.html Sent from the Apache Spark User List mailing list archive at Nabble.com.