Re: Flink kafka consumer disconnection, application processing stays behind

2022-03-25 Thread Qingsheng Ren
Hi Isidoros, Your watermark strategy looks fine to me. I’m not quite sure if it is related. Best regards, Qingsheng > On Mar 24, 2022, at 21:11, Isidoros Ioannou wrote: > > Hi Qingsheng, > > thank you a lot for you response. > The message I see from the consumer before the log exception I

Re: Flink kafka consumer disconnection, application processing stays behind

2022-03-24 Thread Isidoros Ioannou
Hi Qingsheng, thank you a lot for you response. The message I see from the consumer before the log exception I provided previously is this: "locationInformation": "org.apache.kafka.clients.NetworkClient.handleTimedOutRequests(NetworkClient.java:778)", "logger": "org.apache.kafka.clients.Networ

Re: Flink kafka consumer disconnection, application processing stays behind

2022-03-24 Thread Qingsheng Ren
Hi Isidoros, I’m not sure in which kind of way the timeout and the high back pressure are related, but I think we can try to resolve the request timeout issue first. You can take a look at the request log on Kafka broker and see if the request was received by broker, and how long it takes for b