Thanks for that , One more doubt is that How to perform different logic/operations over a Dstreams with two types of Streamid in it . *Its like using stream-id in storm and Fork type of think (diff logic for both edges at same type without using 2 separate filters .).*
On Tue, Jun 30, 2015 at 1:38 AM, Richard Marscher <[email protected]> wrote: > Hi, > > not sure what the context is but I think you can do something similar with > mapPartitions: > > rdd.mapPartitions { iterator => > > iterator.grouped(5).map { tupleGroup => emitOneRddForGroup(tupleGroup) } > > } > > The edge case is when the final grouping doesn't have exactly 5 items, if > that matters. > > On Mon, Jun 29, 2015 at 3:57 PM, anshu shukla <[email protected]> > wrote: > >> I want to apply some logic on the basis of a FIX count of number of >> tuples in each RDD . *suppose emit one rdd for every 5 tuple of >> previous RDD . * >> >> >> >> -- >> Thanks & Regards, >> Anshu Shukla >> > > -- Thanks & Regards, Anshu Shukla
