Re: Join of three streams with different frequency

2020-01-29 Thread Piotr Nowojski
Hey, Yes that’s true for temporal table joins with event time. You would have to make sure that watermarks are progressing, like periodically publish them [1], or some other custom logic. I’m not sure what’s works out of the box in the Table API, however you can always register DataStream as a

Re: Join of three streams with different frequency

2020-01-29 Thread Dominik Wosiński
Hey, But isn't the temporal table join generating output only on watermark ??? I have found such info here: https://stackoverflow.com/questions/54441594/how-to-use-flink-temporal-tables. But since one of the tables will have data that changes very rarely, this would mean that using a temporal table

Re: Join of three streams with different frequency

2020-01-21 Thread Kurt Young
Temporal table functions is supported by both planners, feel free to use any of them. Best, Kurt Dominik Wosiński 于2020年1月21日 周二19:39写道: > Thanksy!! > > I will take a look at the provided links. > Best Regrads, > Dom. > > wt., 21 sty 2020 o 12:35 Piotr Nowojski napisał(a): > > > In Flink Planne

Re: Join of three streams with different frequency

2020-01-21 Thread Dominik Wosiński
Thanksy!! I will take a look at the provided links. Best Regrads, Dom. wt., 21 sty 2020 o 12:35 Piotr Nowojski napisał(a): > In Flink Planner this functionality is supported and exposed via Temporal > Table Functions [2] and it does support event-time [3]. Only the non > function Temporal Table

Re: Join of three streams with different frequency

2020-01-21 Thread Piotr Nowojski
In Flink Planner this functionality is supported and exposed via Temporal Table Functions [2] and it does support event-time [3]. Only the non function Temporal Table syntax is supported only by the Blink, but functionality as far as I recall is the same. [2] https://ci.apache.org/projects/fl

Re: Join of three streams with different frequency

2020-01-21 Thread Dominik Wosiński
Hey, I have considered the Temporal Table Joins, but as far as I know from the docs, it is only currently supported in the Blink Planner and does not currently support event time join, which is why I was trying to find a different solution. Or has anything changed or is my understanding incorrect

Re: Join of three streams with different frequency

2020-01-21 Thread Piotr Nowojski
Hi, You have basically a motivating example between Temporal Table Joins [1]. Please take a look at them. Piotrek [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/streaming/temporal_tables.html

Join of three streams with different frequency

2020-01-20 Thread Dominik Wosiński
Hello, I wanted to ask whether the idea and the general concept that I have is correct or if there is anything better in Flink to use. Say, I that I have 3 different streams : - currency_codes, which has the name of the currency. It has the following fields (*currency_iso_code, tst, curren