Re: how to emit a deletion event for all data in iterating of production logic

2021-08-10 Thread JING ZHANG
Hi vtygoss, You could use `Insert overwrite`[1] syntax if the sink connector supports `overwrite`. Otherwise, please try the following 2 solution: Option A: Define custom source to read the data, and update the header of `RowData` to `Delete` Option B: Do a map function which update the header of `

how to emit a deletion event for all data in iterating of production logic

2021-08-10 Thread vtygoss
Hi, Flink community! I have a problem when iterating the data production logic. e.g. data production procedure: …-> Table A(change log stream) -> Table B(change log stream) ->Table C(change log stream) …. production logic of Table B: insert into table B select * from Table A where a>0;