Re: LEFT and FULL interval joins in Flink SQL leads to very out of order outputs

2023-03-20 Thread Charles Tan
Hi Flink users, Last week I sent an email about some very delayed outputs as a result of running LEFT or FULL interval joins in Flink SQL. I noticed that in a left join, when a record arrives from the left source but there is no matching record from the right source, the watermark for both sides n

LEFT and FULL interval joins in Flink SQL leads to very out of order outputs

2023-03-14 Thread Charles Tan
Hi everyone, I have been playing around with Flink SQL’s interval joins and noticed that some outputs from unmatched LEFT or FULL joins are arriving much later than I expected. Take the following query for example: SELECT * FROM orders o LEFT JOIN shipments s ON (o.orderID = s.orderID) AND o.rowti