Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-26 Thread Aljoscha Krettek
Hi, Yes, after the watermark (or processing-time) pass "end-of-window + allowed-lateness" everything that is stored for a window is deleted. Best, Aljoscha > On 25. Nov 2017, at 18:07, M Singh wrote: > > Hi: > > Another question - what happens if the trigger never calls PURGE or > FIRE_AND_

Taskmanagers are quarantined

2017-11-26 Thread T Obi
Hello all, We run jobs on a standalone cluster with Flink 1.3.2 and we're facing a problem. Suddenly a connection between a taskmanager and the jobmanager is timed out and the taskmanager is "quarantined" by jobmanager. Once a taskmanager is quarantined, of course jobs are restarted, but the timeo

Best way to wait for different events

2017-11-26 Thread Lothium
Hi, I have a question to a specific use case and hope that you can help me with that. I have a streaming pipeline and receive events of different types. I parse the events to their internal representation and do some transformations on them. Some of these events I want to collect internally (groupe

How to perform efficient DataSet reuse between iterations

2017-11-26 Thread Miguel Coimbra
Hello, I'm facing a problem in an algorithm where I would like to constantly update a DataSet representing a graph, perform some computation, output one or more DataSink (such as a file on the local system) and then reuse the DataSet for a next iteration. ​I want to avoid spilling the results to d