attilapiros commented on PR #50277: URL: https://github.com/apache/spark/pull/50277#issuecomment-2783496530
LGTM The change makes sense for me. Even a helper class used by the `MapOutputTrackerMaster` mentions the possible null values (_"Each value in the array is the MapStatus for a partition, or null if the partition is not available."_): https://github.com/apache/spark/blob/738a50364f16c579e370736df92bf01fe0a06af1/core/src/main/scala/org/apache/spark/MapOutputTracker.scala#L86-L95 Shuffle dependencies are registered very early to the `ContextCleaner` so at a failure/manual stop some map statues can be easily missing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
