Re: Kafka Consumer consuming rate suddenly dropped

2020-07-22 Thread Jake
Hi Mu Kong Yes, you need check your kafka cluser server log, network traffic, disk latency, cpu load. Jake > On Jul 22, 2020, at 7:34 PM, Till Rohrmann wrote: > > Hi Mu Kong, > > I think Jake was asking for the logs of your Kafka cluster and not the Flink > TM logs. > > Cheers, > Till >

Re: Kafka Consumer consuming rate suddenly dropped

2020-07-22 Thread Till Rohrmann
Hi Mu Kong, I think Jake was asking for the logs of your Kafka cluster and not the Flink TM logs. Cheers, Till On Wed, Jul 22, 2020 at 12:47 PM Mu Kong wrote: > Hi, Jake, > > Thanks for offering help. > I didn't find anything related to kafka in my tm log. > Is there a way to enable the loggin

Re: Kafka Consumer consuming rate suddenly dropped

2020-07-22 Thread Mu Kong
Hi, Jake, Thanks for offering help. I didn't find anything related to kafka in my tm log. Is there a way to enable the logging, or am I just looking into the wrong place? Thanks in advance. Best regards, Mu

Re: Kafka Consumer consuming rate suddenly dropped

2020-07-20 Thread Jake
Need some flink kafka consumer log and kafka server log! > On Jul 20, 2020, at 5:45 PM, Mu Kong wrote: > > Hi, community > > I have a flink application consuming from a kafka topic with 60 partitions. > The parallelism of the source is set to 60, same with the topic partition > number. > The