Re: Timestamp Erasure

2020-03-19 Thread Jark Wu
Hi Dom, The output elements from ProcessingTime timer in BroadcastProcessFunction or KeyedCoProcessFunction will be erased timestamp. So you have to assign a new `*assignTimestampsAndWatermarks` *after that, or use EventTime timer. Best, Jark On Thu, 19 Mar 2020 at 16:40, Dominik Wosiński wrote

Re: Timestamp Erasure

2020-03-19 Thread Dominik Wosiński
Yes, I understand this completely, but my question is a little bit different. The issue is that if I have something like : *val firstStream = dataStreamFromKafka* *.assignTimestampAndWatermarks(...)* *val secondStream = otherStreamFromKafka* *.assignTimestampsAndWatermarks(...)* *.broadcast(...)*

Re: Timestamp Erasure

2020-03-18 Thread Jark Wu
Hi Dom, If you are converting a DataStream to a Table with a rowtime attribute, then the DataStream should hold event-time timestamp. For example, call `assignTimestampsAndWatermarks` before converting to table. You can find more details in the doc [1]. Best, Jark [1]: https://ci.apache.org/pr

Timestamp Erasure

2020-03-18 Thread Dominik Wosiński
Hey, I just wanted to ask about one thing about timestamps. So, currently If I have a KeyedBroadcastProcess function followed by Temporal Table Join, it works like a charm. But, say I want to delay emitting some of the results due to any reason. So If I *registerProcessingTimeTimer* and any elemen