I am building my own custom RDD class. 1) Is there a guarantee that a partition will only be processed on a node which is in the "getPreferredLocations" set of nodes returned by the RDD ?
2) I am implementing this custom RDD in Java and plan to extend JavaRDD. However, I dont see a "getPreferredLocations" method in http://spark.apache.org/docs/latest/api/core/index.html#org.apache.spark.api.java.JavaRDD Will I be able to implement my own custom RDD in Java and be able to override the "getPreferredLocations" method ? Thanks Anand -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/getPreferredLocations-tp6554.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
