Re: A question about flink sql retreact stream

2020-11-05 Thread Jark Wu
Yes. There is also a Flink Forward session [1] (since 14:00) talked about the internals of the underlying changelog mechanism with a visual example. Best, Jark [1]: https://www.youtube.com/watch?v=KDD8e4GE12w&list=PLDX4T_cnKjD0ngnBSU-bYGfgVv17MiwA7&index=48&t=820s On Thu, 5 Nov 2020 at 15:48, H

Re: A question about flink sql retreact stream

2020-11-04 Thread Jark Wu
Thanks Henry for the detailed example, I will explain why so many records at time 5. That is because the retraction mechanism is per-record triggered in Flink SQL, so there is record amplification in your case. At time 5, the LAST_VALUE aggregation for stream a will first emit -(1, 12345, 0) and t

A question about flink sql retreact stream

2020-11-04 Thread Henry Dai
Dear flink developers&users I have a question about flink sql, It gives me a lot of trouble, Thank you very much for some help. Lets's assume we have two data stream, `order` and `order_detail`, they are from mysql binlog. Table `order` schema: id int primary key

A question about flink sql retreact stream

2020-11-04 Thread Henry Dai
Dear flink developers&users I have a question about flink sql, It gives me a lot of trouble, Thank you very much for some help. Lets's assume we have two data stream, `order` and `order_detail`, they are from mysql binlog. Table `order` schema: id int primary key