Re: BlinkPlanner limitation related clarification

2020-01-26 Thread RKandoji
Hi Jingsong, Thanks for the information. Not sure if I'm missing anything but I have been reusing table env and didn't see anything wrong, I'm worried if I'm missed to note anything? My use case: I created a class level StreamTableEnvironment and used it throughout my code for creating multiple t

Re: Blocking KeyedCoProcessFunction.processElement1

2020-01-26 Thread Yun Tang
Hi Alexey Actually, I don't understand why you thing KeyedCoProcessFunction#processElement1 would block for significant amount of time, it just process record from the elements in the first input stream which is necessary. If you really find it would block for a long time, I think that's becau

Re: [State Processor API] how to convert savepoint back to broadcast state

2020-01-26 Thread Yun Tang
Hi Yi Can the official doc of writing broad cast state [1] satisfies your request? [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#broadcast-state-1 Best Yun Tang From: Jin Yi Sent: Thursday, January 23, 2020 8:12 To

[ANNOUNCE] Weekly Community Update 2020/04

2020-01-26 Thread Konstantin Knauf
Dear community, happy to share a brief community digest after a rather quite week including updates on Flink 1.9.2 and Flink 1.10, and the ongoing votes on FLIP-27 (New Source Interface) and FLIP-92 (N-Ary Stream Operator). Flink Development == * [releases] Hequn has published the fi

Re: [State Processor API] how to convert savepoint back to broadcast state

2020-01-26 Thread Jin Yi
Hi Yun, Thanks for the response, I have checked official document, and I have referred this example to write the broadcast state to a savepoint. My question is: I can use state processor api to read back the savepoint into a dataSet, but how can I use the dataSet as the initial value for the broa

SideOutput Exception: "Output Tag must not be null"

2020-01-26 Thread izual
I followed docs[1] and SideOutputITCase.scala(unittest case from flink-master), but encountered an Exception: Caused by: java.lang.IllegalArgumentException: OutputTag must not be null. code snippet implemented by Scala ``` private final val backupOutputTag = OutputTag[String]("backup") v

Re: [State Processor API] how to convert savepoint back to broadcast state

2020-01-26 Thread Jin Yi
Hi Yun, After search around in the documentation, I tried extends BroadcastProcessFunction implements CheckpointedFunction. And I have initialized broadcast state in public void initializeState(FunctionInitializationContext context) method, it seems working fine. Here is the doc I followed: https