Ah, thank you so much, this is perfect
On Fri, Nov 20, 2015 at 3:48 PM, Ali Tajeldin EDU
wrote:
> You can try to use an Accumulator (
> http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.Accumulator)
> to keep count in map1. Note that the final count may be higher than th
You can try to use an Accumulator
(http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.Accumulator)
to keep count in map1. Note that the final count may be higher than the
number of records if there were some retries along the way.
--
Ali
On Nov 20, 2015, at 3:38 PM, jlua
