Re: reduce, transform, combine

2014-05-04 Thread Manish Amde
Thanks DB. I will work with mapPartition for now.  Question to the community in general: should we consider adding such an operation to RDDs especially as a developer API? On Sun, May 4, 2014 at 1:41 AM, DB Tsai wrote: > You could easily achieve this by mapPartition. However, it seems that it

Re: reduce, transform, combine

2014-05-04 Thread DB Tsai
You could easily achieve this by mapPartition. However, it seems that it can not be done by using aggregate type of operation. I can see that it's a general useful operation. For now, you could use mapPartition. Sincerely, DB Tsai --- My Blog: