To add a bit on this one, if you look at RDD.scala in Spark code, you'll see that both "parent" and "firstParent" methods are protected[spark].
I guess, for good reasons, that I must admit I don't understand completely, you are not supposed to explore an RDD lineage programmatically... I had a usecase myself and was disappointed to find out about this. Anyone could enlighten me on the reasons for this restriction? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-there-a-way-to-look-at-RDD-s-lineage-Or-debug-a-fault-tolerance-error-tp15959p16041.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
