applying keyed state on top of stream from co-groupByKey output

2019-07-23 Thread Kiran Hurakadli
Hi All, I am trying to merge 2 data streams using coGroupByKey and applying stateful ParDo. Input to the cogroup fun is (word,count) , Full problem explained on stack over flow https://stackoverflow.com/questions/57162131/applying-keyed-state-on-top-of-stream-from-co-group-stream Please help me -

How to merge two streams and perform stateful operations on merged stream using Apache Beam

2019-07-24 Thread Kiran Hurakadli
I have 2 kafka streams , i want to merge by some key and on top of the merged stream i want to perform stateful operation so that i can sum up counts from both streams this what i tried, but dint work .. PCollection stream1 = .. read from kafka PCollection stream2 = .. read from kafka PCollect

Re: How to merge two streams and perform stateful operations on merged stream using Apache Beam

2019-07-25 Thread Kiran Hurakadli
u explain a little more? > > Kenn > > On Wed, Jul 24, 2019 at 10:48 PM Kiran Hurakadli > wrote: > >> I have 2 kafka streams , i want to merge by some key and on top of the >> merged stream i want to perform stateful operation so that i can sum up >> counts f

Re: applying keyed state on top of stream from co-groupByKey output

2019-07-25 Thread Kiran Hurakadli
Thank you for your response On Thu, 25 Jul 2019 at 9:32 PM, Kenneth Knowles wrote: > Thanks for the very detailed question! I have written up an answer and I > suggest we continue discussion there. > > Kenn > > On Tue, Jul 23, 2019 at 9:11 PM Kiran Hurakadli > wrote: &g

Re: applying keyed state on top of stream from co-groupByKey output

2019-07-25 Thread Kiran Hurakadli
an answer and I >> suggest we continue discussion there. >> >> Kenn >> >> On Tue, Jul 23, 2019 at 9:11 PM Kiran Hurakadli >> wrote: >> >>> >>> Hi All, >>> I am trying to merge 2 data streams using coGroupByKey and applying

Side input of size around 50Mb causing long GC pause

2020-04-07 Thread Kiran Hurakadli
I have facing issue related to side inputs and mentioned it in this link https://stackoverflow.com/questions/60900937/side-input-of-size-around-50mb-causing-long-gc-pause Any help would be appreciated -- Regards, *Kiran M Hurakadli.*

Fwd: Side input of size around 50Mb causing long GC pause

2020-04-19 Thread Kiran Hurakadli
Plz help me ! -- Forwarded message - From: Kiran Hurakadli Date: Tue, 7 Apr 2020 at 3:51 PM Subject: Side input of size around 50Mb causing long GC pause To: I have facing issue related to side inputs and mentioned it in this link https://stackoverflow.com/questions/60900937