ahshahid commented on PR #50029: URL: https://github.com/apache/spark/pull/50029#issuecomment-2675898956
> It is unclear to me why the changes to spark core are required - marking the RDD with the appropriate `DeterministicLevel` should be sufficient. In case of ShuffleMap stage, the base RDD itself might be deterministic but the Partitioner may be not. If any of the changes present are removed, tests will fail. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
