Hi, Is it possible to know from code about an RDD if it is cached, and more precisely, how many of its partitions are cached in memory and how many are cached on disk? I know I can get the storage level, but I also want to know the current actual caching status. Knowing memory consumption would also be awesome. :)
Basically what I'm looking for is the information on the storage tab of the UI, but accessible from the API. Thanks, Andras
