JavaSparkContext currentContext = ...;
Accumulator<Integer> accumulator = currentContext.accumulator(0,
"MyAccumulator");
will create an Accumulator of Integers. For many large Data problems
Integer is too small and Long is a better type.
I see a call like the following
AccumulatorParam<Long> param = ?? how do I get one of these;
// no compiler is unhappy with this call
Accumulator<Long> accumulatorLong = currentContext.accumulator(new
Long(0), acc ,param);
but NONE - ZERO documentation on its use, how to get a
AccumulatorParam<Long> or how to turn one into an Accumulator.
Any ideas