Re: Problem with Kafka Consumer

2017-05-18 Thread simone
Hi Kostas, As suggested I switched to version 1.3-SNAPSHOT and the project run without any problem. I will keep you informed if any other issue occurs. Thanks again for the help. Cheers, Simone. On 16/05/2017 16:36, Kostas Kloudas wrote: Hi Simone, Glad I could help ;) Actually it would b

Re: Problem with Kafka Consumer

2017-05-16 Thread Kostas Kloudas
Hi Simone, Glad I could help ;) Actually it would be great if you could also try out the upcoming (not yet released) 1.3 version and let us know if you find something that does not work as expected. We are currently in the phase of testing it, as you may have noticed, and every contribution t

Re: Problem with Kafka Consumer

2017-05-16 Thread simone
Hi Kostas, thanks for your suggestion. Indeed, replacing my custom sink with a simpler one problem bring out that the cause of the problem was RowToQuery as you suggested. The sink was blocking the reads making the Kafka pipeline stall, due to a misconfiguration of an internal client that is

Re: Problem with Kafka Consumer

2017-05-16 Thread Kostas Kloudas
Hi Simone, I suppose that you use messageStream.keyBy(…).window(…) right? .windowAll() is not applicable to keyedStreams. Some follow up questions are: In your logs, do you see any error messages? What does your RowToQuery() sink do? Can it be that it blocks and the back pressure makes all th