Re: Kafka Sink stuck in cancelling

2016-11-22 Thread Gyula Fóra
Ah sorry I completely missed the version details. I am using Flink 1.1.3 with Kafka 0.8 producer. We havent had issues with the consumers yet and this is the first time this happenned as well. Gyula On Tue, Nov 22, 2016, 12:15 Till Rohrmann wrote: > Hi Gyula, > > I'm not aware of any recent is

Re: Kafka Sink stuck in cancelling

2016-11-22 Thread Till Rohrmann
Hi Gyula, I'm not aware of any recent issues with the Kafka Producer. However there was one with the Kafka Consumer which prevented the proper cancellation ( https://issues.apache.org/jira/browse/FLINK-5048). Which version of Flink and which Kafka Producer were you using? Cheers, Till On Tue, N

Re: Kafka Sink stuck in cancelling

2016-11-22 Thread Stephan Ewen
Hi Gyula! Not sure what is happening there. I found that the Kafka code had a few issues with cancellation and concurrent closing. That affected mostly the producer, though. What Kafka version are you using? 0.8 or 0.9? Greetings, Stephan On Tue, Nov 22, 2016 at 10:03 AM, Gyula Fóra wrote: >

Kafka Sink stuck in cancelling

2016-11-22 Thread Gyula Fóra
Hi, Has anyone ever experienced the Kafka producer getting stuck in cancelling? I am aware that there were problems with the Kafka consumer before but I haven't seen this one yet. It happened simultaneously to 3 of my jobs last night, they were stuck from about 8 pm to 8 am (not exact times but y