[DISCUSS] KIP-424: Allow suppression of intermediate events based on wall clock time

2019-01-29 Thread jonathangordon
Hi all, I just published KIP-424: Allow suppression of intermediate events based on wall clock time https://cwiki.apache.org/confluence/display/KAFKA/KIP-424%3A+Allow+suppression+of+intermediate+events+based+on+wall+clock+time I am eager to hear your feedback and concerns. Thanks John Roesler f

Re: [DISCUSS] KIP-424: Allow suppression of intermediate events based on wall clock time

2019-02-25 Thread jonathangordon
On 2019/02/21 02:19:27, "Matthias J. Sax" wrote: > thanks for the KIP. Corner case question: > > What happens if an application is stopped an restarted? > > - Should suppress() flush all records (would be _before_ the time elapsed)? > - Or should it preserve buffered records and reload on res

Re: [DISCUSS] KIP-424: Allow suppression of intermediate events based on wall clock time

2019-04-07 Thread jonathangordon
On 2019/03/11 21:39:18, John Roesler wrote: > Regarding flushing on shutdown, can you elaborate of the motivation for > doing so? I'm not in any way attached to this idea if you think it's not any additional trouble. It wasn't obvious to me how you would store the "wall clock time last flushed

Re: [DISCUSS] KIP-424: Allow suppression of intermediate events based on wall clock time

2019-05-02 Thread jonathangordon
I'd like to move this KIP along. To summarize where we've landed so far: - Should suppress() flush all records (would be _before_ the time elapsed)? - Or should it preserve buffered records and reload on restart? For this case, should the record be flushed on reload (elapsed time is unknown) or sh