Re: Joining Flink tables with different watermark delay

2022-02-16 Thread Francesco Guardiani
> We plan to use this parquet source to create a Hybrid Source later. Hence, we had to use a File Source. FYI there is an open issue for this: https://issues.apache.org/jira/browse/FLINK-22793, but for the other points it makes sense to create the data stream directly, as it circumvents the intrin

Re: Joining Flink tables with different watermark delay

2022-02-15 Thread Meghajit Mazumdar
Hi Francesco, Thank you so much for your reply. This was really helpful. In reply to your tips: *> As described here , we have deprecated the syntax `GROUP BY WINDOW`, you should

Re: Joining Flink tables with different watermark delay

2022-02-14 Thread Francesco Guardiani
Hi, So my understanding of your query is that you want to do a join first, and then group by a 60 minutes distance and aggregate them. Please correct me if I'm wrong. First of all, the query you've posted is incorrect and should fail, as its plan is invalid because it's using a regular join. Regu