Re: Flink 1.11 Simple pipeline (data stream -> table with egg -> data stream) failed

2020-07-27 Thread Timo Walther
Hi Dmytro, one major difference between legacy and Blink planner is that the Blink planner is not build on top of DataStream API. It uses features of lower levels (StreamOperator, Transformation). In the mid-term we want to remove the check and make Table API and DataStream API 100% back and

Re: Flink 1.11 Simple pipeline (data stream -> table with egg -> data stream) failed

2020-07-24 Thread Dmytro Dragan
Hi Timo, Thank you for response. Well, it was working. We have a number of pipelines in production which reuse DataStream and Table API parts on Flink 1.10, both for stream and batch. The same that simple case without aggregation would work in Flink 1.11 But let`s assume there are some incompati

Re: Flink 1.11 Simple pipeline (data stream -> table with egg -> data stream) failed

2020-07-24 Thread Timo Walther
Hi Dmytro, `StreamTableEnvironment` does not support batch mode currently. Only `TableEnvironment` supports the unified story. I saw that you disabled the check in the `create()` method. This check exists for a reason. For batch execution, the planner sets specific properties on the stream g

Flink 1.11 Simple pipeline (data stream -> table with egg -> data stream) failed

2020-07-23 Thread Dmytro Dragan
Hi All, We are working on migration existing pipelines from Flink 1.10 to Flink 1.11. We are using Blink planner and have unified pipelines which can be used in stream and batch mode. Stream pipelines works as expected, but batch once fail on Flink 1.11 if they have any table aggregation transf