+1 for Jacek's suggestion
FWIW: another possible *hacky* way is to write a package
in org.apache.spark.sql namespace so it can access the
sparkSession.sharedState.cacheManager. Then use scala reflection to read
the cache manager's `cachedData` field, which can provide the list of
cached relations.
Hi,
I think that the only way to get the information about a cached RDD is to
use SparkListener and intercept respective events about cached blocks on
BlockManagers.
Jacek
On 25 Jan 2017 5:54 a.m., "kumar r" wrote:
Hi,
I have cached some table in Spark Thrift Server. I want to get all cached
