Re: I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-27 Thread Fabian Hueske
ot;Fabian Hueske" > *An: *"Zhenghua Gao" > *CC: *"Theo Diefenthal" , "user" < > user@flink.apache.org> > *Gesendet: *Freitag, 16. August 2019 10:05:45 > *Betreff: *Re: I'm not able to make a stream-stream Time windows JOIN in > Flink SQ

Re: I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-23 Thread Theo Diefenthal
o query (as the "same day"-predicate is still missing). Best regards Theo Von: "Fabian Hueske" An: "Zhenghua Gao" CC: "Theo Diefenthal" , "user" Gesendet: Freitag, 16. August 2019 10:05:45 Betreff: Re: I'm not able to make a strea

Re: I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-16 Thread Fabian Hueske
Hi Theo, The main problem is that the semantics of your join (Join all events that happened on the same day) are not well-supported by Flink yet. In terms of true streaming joins, Flink supports the time-windowed join (with the BETWEEN predicate) and the time-versioned table join (which does not

Re: I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-13 Thread Zhenghua Gao
I wrote a demo example for time windowed join which you can pick up [1] [1] https://gist.github.com/docete/8e78ff8b5d0df69f60dda547780101f1 *Best Regards,* *Zhenghua Gao* On Tue, Aug 13, 2019 at 4:13 PM Zhenghua Gao wrote: > You can check the plan after optimize to verify it's a regular join

Re: I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-13 Thread Zhenghua Gao
You can check the plan after optimize to verify it's a regular join or time-bounded join(Should have a WindowJoin). The most direct way is breakpoint at optimizing phase [1][2]. And you can use your TestData and create an ITCase for debugging [3] [1] https://github.com/apache/flink/blob/master/fl

I'm not able to make a stream-stream Time windows JOIN in Flink SQL

2019-08-12 Thread Theo Diefenthal
Hi there, Currently, I'm trying to write a SQL query which shall executed a time windowed/bounded JOIN on two data streams. Suppose I have stream1 with attribute id, ts, user and stream2 with attribute id, ts, userName. I want to receive the natural JOIN of both streams with events of the sa