Re: [DISCUSS] KIP-695: Improve Streams Time Synchronization

2020-12-08 Thread John Roesler
Thanks for taking a look, Bruno! You have a sharp eye. All I meant by that is that we don't want to draw conclusions from metadata that we received a long time ago (for example, if fetches have been failing), but we also don't want to enforce waiting on a new fetch every single time we process a t

Re: [DISCUSS] KIP-695: Improve Streams Time Synchronization

2020-12-08 Thread Bruno Cadonna
Thank you for the KIP, John! Overall, the KIP looks good to me. I was just wondering what do you mean by "too stale". Could you define "too stale"? Best, Bruno On 04.12.20 23:39, John Roesler wrote: Hello all, I'd like to propose KIP-695 to improve on the "task idling" feature we introduce

[DISCUSS] KIP-695: Improve Streams Time Synchronization

2020-12-04 Thread John Roesler
Hello all, I'd like to propose KIP-695 to improve on the "task idling" feature we introduced in KIP-353. This KIP will allow Streams to offer deterministic time semantics in join-type topologies. For example, it makes sure that when you join two topics, that we collate the topics by timestamp. Tha