Re: Question regarding GoupByKey operator on unbounded data

2020-12-16 Thread Tao Li
uot;user@beam.apache.org" Subject: Re: Question regarding GoupByKey operator on unbounded data Hi, I think what you might be looking for is "stateful processing", please have a look at [1]. Note that input to stateful DoFn must be of type KV, which then ensures similar beha

Re: Question regarding GoupByKey operator on unbounded data

2020-12-14 Thread Jan Lukavský
PM *To: *"user@beam.apache.org" , Reuven Lax *Cc: *Mehmet Emre Sahin , Ying-Chang Cheng *Subject: *Re: Question regarding GoupByKey operator on unbounded data Would Combine.PerKey work for my case? Seems like it does not require a window function. At the same time it seems that this oper

Re: Question regarding GoupByKey operator on unbounded data

2020-12-12 Thread Tao Li
Reuven Lax Cc: Mehmet Emre Sahin , Ying-Chang Cheng Subject: Re: Question regarding GoupByKey operator on unbounded data Would Combine.PerKey work for my case? Seems like it does not require a window function. At the same time it seems that this operator is typically used to generate some

Re: Question regarding GoupByKey operator on unbounded data

2020-12-11 Thread Tao Li
. Thanks! From: Tao Li Reply-To: "user@beam.apache.org" Date: Friday, December 11, 2020 at 10:29 AM To: "user@beam.apache.org" , Reuven Lax Cc: Mehmet Emre Sahin , Ying-Chang Cheng Subject: Re: Question regarding GoupByKey operator on unbounded data Hi @Reuven Lax<

Re: Question regarding GoupByKey operator on unbounded data

2020-12-11 Thread Tao Li
Ying-Chang Cheng Subject: Re: Question regarding GoupByKey operator on unbounded data Can you explain more about what exactly you are trying to do? On Thu, Dec 10, 2020 at 2:51 PM Tao Li mailto:t...@zillow.com>> wrote: Hi Beam community, I got a quick question about GoupByKey operator.

Re: Question regarding GoupByKey operator on unbounded data

2020-12-10 Thread Reuven Lax
Can you explain more about what exactly you are trying to do? On Thu, Dec 10, 2020 at 2:51 PM Tao Li wrote: > Hi Beam community, > > > > I got a quick question about GoupByKey operator. According to this doc > , if > we are us

Question regarding GoupByKey operator on unbounded data

2020-12-10 Thread Tao Li
Hi Beam community, I got a quick question about GoupByKey operator. According to this doc, if we are using unbounded PCollection, it’s required to specify either non-global windowing