Re: consistency between input, output and changelog streams

2015-04-24 Thread Yan Fang
he fact that we saw it), so that on replay of the >> first message you can determine that, while you have seen an input from >> this group, this is the replay of that first input and it should be >> re-emitted to the output stream. >> >> -Bart >> >> &g

Re: consistency between input, output and changelog streams

2015-04-08 Thread Yan Fang
o the output stream. > > -Bart > > > > > -Original Message- > From: Yan Fang [mailto:yanfang...@gmail.com] > Sent: Tuesday, April 7, 2015 4:12 PM > To: dev@samza.apache.org > Subject: Re: consistency between input, output and changelog streams > > Hi

RE: consistency between input, output and changelog streams

2015-04-08 Thread Bart Wyatt
o: dev@samza.apache.org Subject: Re: consistency between input, output and changelog streams Hi Bart, In terms of your assumption, * Ts <= To , this is correction. The code backups this assumption is here: in RunLoop <https://github.com/apache/samza/blob/master/samza-core/src/main/sca

Re: consistency between input, output and changelog streams

2015-04-07 Thread Yan Fang
Hi Bart, In terms of your assumption, * Ts <= To , this is correction. The code backups this assumption is here: in RunLoop , the commit is called after each process and window methods