Re: A WordCount job using DataStream API but behave like the batch WordCount example

2023-04-29 Thread Ken Krugler
Hi Luke, What’s your workflow look like? The one I included in my email generates what I’d expect. — Ken > On Apr 29, 2023, at 7:22 PM, Luke Xiong wrote: > > Hi Marco and Ken, > > Thanks for the tips. I tried setting runtime mode to BATCH and it seems to > work. However, I notice there are

Re: A WordCount job using DataStream API but behave like the batch WordCount example

2023-04-29 Thread Marco Villalobos
Hi Luke, A batch has a beginning and an end. Although a stream has a beginning, it has no end. Thus, you'll have three choices: 1. You can collect your aggregated sum at a period interval 2. You can aggregate the sum in a time window. If your window is large enough, you'll get the same result.