Hi, Just to make sure that what I see in the code and think I understand is indeed correct...
When a job is submitted to DAGScheduler, it creates a new ResultStage that in turn queries for the parent stages of itself given the RDD (using `getParentStagesAndId` in `newResultStage`). Are a ResultStage's parent stages only ShuffleMapStages? Pozdrawiam, Jacek -- Jacek Laskowski | http://blog.japila.pl | http://blog.jaceklaskowski.pl Follow me at https://twitter.com/jaceklaskowski Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
