Re: Flink SQL : Interval Outer/Left Join not working as expected

2021-03-19 Thread Benchao Li
Glad to hear that you resolved the issue. Aneesha Kaushal 于2021年3月19日周五 下午10:49写道: > Hello Benchao, > > Thanks for clarifying! > The issue was I send very few records so I could not test how the > watermark is progressing. Today after trying on continuous stream I was > able to get the results.

Re: Flink SQL : Interval Outer/Left Join not working as expected

2021-03-19 Thread Aneesha Kaushal
Hello Benchao, Thanks for clarifying! The issue was I send very few records so I could not test how the watermark is progressing. Today after trying on continuous stream I was able to get the results. On Fri, Mar 19, 2021 at 5:24 PM Benchao Li wrote: > Hi Aneesha, > > For the interval join ope

Re: Flink SQL : Interval Outer/Left Join not working as expected

2021-03-19 Thread Benchao Li
Hi Aneesha, For the interval join operator will output the data with NULL when it confirms that there will no data coming before the watermark. And there is an optimization for reducing state access, which may add more time to trigger the output of these data. For your case, it's almost 30 + 30 =

Flink SQL : Interval Outer/Left Join not working as expected

2021-03-18 Thread Aneesha Kaushal
Hi, I am doing a simple POC using Flink SQL and I am facing some issues with Interval Join. *Use Case*: I have two Kafka streams and using Flink SQL interval join I want to remove rows from* stream 1*(abandoned_user_visits) that are present in *stream 2*(orders) within some time interval. *Data: