No, I am not using serializing either with memory or disk.
Dave Jaffe
VMware
dja...@vmware.com
From: Shreya Agarwal
Date: Monday, November 7, 2016 at 3:29 PM
To: Dave Jaffe , "user@spark.apache.org"
Subject: RE: Anomalous Spark RDD persistence behavior
I don’t think this is corre
I don’t think this is correct. Unless you are serializing when caching to
memory but not serializing when persisting to disk. Can you check?
Also, I have seen the behavior where if I have 100 GB in-memory cache and I use
60 GB to persist something (MEMORY_AND_DISK). Then try to persist another R
