Hi all, I'm incrementing several accumulators inside a foreach. Most of the time, the accumulators will return the same value for the same dataset. However, they sometimes differ.
I'm not sure how accumulators are implemented. Could this behavior be caused by data not arriving before I print out the value of the accumulator? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Non-deterministic-Accumulator-Values-tp21837.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
