ahshahid commented on PR #50757: URL: https://github.com/apache/spark/pull/50757#issuecomment-2845350793
I also doubt that user would be able to specify the inDeterminancy flag in the Map operations as I think it is going to make it complicated for user to understand its impact, and if inadvertently to feel safe if he /she marks it as inDeterminate, the cost would be very high in terms of unnnecessary retry. When after going inside the code, we are struggling with the interpretation / behaviour of inDeterminancy, expecting user to do that is a big ask. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
