How are timestamps treated within an iterative DataStream loop within Flink?

2019-06-08 Thread John Tipper
Hi All, How are timestamps treated within an iterative DataStream loop within Flink? For example, here is an example of a simple iterative loop within Flink where the feedback loop is of a different type to the input stream: DataStream inputStream = env.addSource(new MyInputSourceFunction()); I

Loading state from sink/understanding recovery options

2019-06-08 Thread Eduardo Winpenny Tejedor
Hi, In generic terms, if a keyed operator outputs its state into a sink, and the state of that operator after a restart can be derived from the sink's contents, can we do just that, as opposed to using checkpointing mechanics? Would that reduce latency (even if only theoretically)? An example: A