Re: Questions about Accumulators

2015-05-03 Thread Dean Wampler
, the map() operation > re-executed(map(x => accumulator += x) re-executed), then the final result > of acculumator will be "2", twice as the correct result? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Questions

Re: Questions about Accumulators

2015-05-03 Thread xiazhuchang
ew this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Questions-about-Accumulators-tp22746p22747.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-un

Re: Questions about Accumulators

2015-05-03 Thread Eugen Cepoi
e than once if the task restarte? And then the final result > will be many times of the real result? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Questions-about-Accumulators-tp22746.html

Re: Questions about Accumulators

2015-05-03 Thread Ignacio Blasco
that meas if i use the > accumulator in transformations(i.e. map() operation), this operation will > be > execuated more than once if the task restarte? And then the final result > will be many times of the real result? > > > > -- > View this message in context: &g

Questions about Accumulators

2015-05-03 Thread xiazhuchang
peration), this operation will be execuated more than once if the task restarte? And then the final result will be many times of the real result? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Questions-about-Accumulators-tp22746.html Sent from the Apache