Re: Lost data when resuming from savepoint

2017-10-09 Thread Fabian Hueske
Hi Jose, I had a look at your program but did not spot anything. The query is a simple "SELECT FROM WHERE" query that does not have any state. So the only state is the state of the Kafka source, i.e, the offset. How much time did pass between taking the savepoint and resuming? Did you see any exc

Lost data when resuming from savepoint

2017-10-06 Thread Jose Miguel Tejedor Fernandez
Hi, I am running a simple stream Flink job (Flink version 1.3.2 and 1.3.1) whose source and sink is a Kafka cluster 0.10.0.1. I am testing savepoints by stopping/resuming the job and when I checked the validity of the data sunk during the stop time I observed that some of the events have been los