IgorBerman commented on PR #46904: URL: https://github.com/apache/spark/pull/46904#issuecomment-2585668069
I'm a bit late to this PR we got same problem recently in code with following scenario: we have javaRDD that have some "pojo" that references accumulator this javaRDD's data created at executors, so it seems that writeReplace is used for some reason at executor's side but at code path it "thinks" it's running on driver's side. I'm not 100% sure why executor will use writeReplace in this case, but I've managed to catch it with debuging executor -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
