Yes, Spark goes through the standard HDFS client and will automatically benefit from this.
Matei On May 8, 2014, at 4:43 AM, Chanwit Kaewkasi <chan...@gmail.com> wrote: > Hi all, > > Can Spark (0.9.x) utilize the caching feature in HDFS 2.3 via > sc.textFile() and other HDFS-related APIs? > > http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html > > Best regards, > > -chanwit > > -- > Chanwit Kaewkasi > linkedin.com/in/chanwit
