ShuffleMapStage and pendingPartitions vs isAvailable or findMissingPartitions?

Hi, I found that ShuffleMapStage has this (apparently superfluous) pendingPartitions registry [1] for DAGScheduler and the description says: " /** * Partitions that either haven't yet been computed, or that were computed on an executor * that has since been lost, so should be re-computed.

Re: BlockManager and ShuffleManager = can getLocalBytes be ever used for shuffle blocks?

Thanks Yi Wu! Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski "The Internals Of" Online Books Follow me on https://twitter.com/jaceklaskowski On Sat, Apr 18, 2020 at 12:17 PM wuyi wrote: > Hi Jacek, > > code in l