Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-13 Thread Ismael Juma
iginal Message- > From: isma...@gmail.com [mailto:isma...@gmail.com] On Behalf Of Ismael > Juma > Sent: 12 April 2016 16:24 > To: users@kafka.apache.org > Subject: Re: KafkaProducer 0.9.0.1 continually sends metadata requests > > Hi Jonathan, > > That makes sense,

RE: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-13 Thread Phil Luckhurst
users@kafka.apache.org Subject: Re: KafkaProducer 0.9.0.1 continually sends metadata requests Hi Jonathan, That makes sense, thanks. Phil, do you know if your metadata requests are succeeding? Retrying every retry.backoff.ms is expected if they fail, but not if they succeed. In terms of posting a comment to

Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Ismael Juma
; > > > phil.luckhu...@encycle.com> wrote: > > > > > >> Thanks Jonathan, I didn't spot that JIRA. > > >> > > >> Phil > > >> > > >> -Original Message- > > >> From: Jonathan Bond [mailto:jb...@netflix.com.INVALID] >

RE: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Phil Luckhurst
er 0.9.0.1 continually sends metadata requests Sorry, I should say that KAFKA-3306 will fix the issue where we request data for all topics instead of no topics. However, it seems like there is an additional issue where it seems like we are performing metadata requests too frequently. Phil, can you

Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Jonathan Bond
:17 PM, Phil Luckhurst < > > phil.luckhu...@encycle.com> wrote: > > > >> Thanks Jonathan, I didn't spot that JIRA. > >> > >> Phil > >> > >> -Original Message----- > >> From: Jonathan Bond [mailto:jb...@netflix.com.INVALID

Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Ismael Juma
il.luckhu...@encycle.com> wrote: > >> Thanks Jonathan, I didn't spot that JIRA. >> >> Phil >> >> -Original Message- >> From: Jonathan Bond [mailto:jb...@netflix.com.INVALID] >> Sent: 12 April 2016 14:08 >> To: users@kafka.apache.org &

Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Ismael Juma
...@netflix.com.INVALID] > Sent: 12 April 2016 14:08 > To: users@kafka.apache.org > Subject: Re: KafkaProducer 0.9.0.1 continually sends metadata requests > > Phil, > In our case this bug placed significant load on our brokers. We raised a > bug https://issues.apache.org/j

RE: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Phil Luckhurst
Thanks Jonathan, I didn't spot that JIRA. Phil -Original Message- From: Jonathan Bond [mailto:jb...@netflix.com.INVALID] Sent: 12 April 2016 14:08 To: users@kafka.apache.org Subject: Re: KafkaProducer 0.9.0.1 continually sends metadata requests Phil, In our case this bug p

Re: KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Jonathan Bond
Phil, In our case this bug placed significant load on our brokers. We raised a bug https://issues.apache.org/jira/browse/KAFKA-3358 to get this resolved. On Tue, Apr 12, 2016 at 5:39 AM Phil Luckhurst wrote: > With debug logging turned on we've sometimes seen our logs filling up with > the kafk

KafkaProducer 0.9.0.1 continually sends metadata requests

2016-04-12 Thread Phil Luckhurst
With debug logging turned on we've sometimes seen our logs filling up with the kafka producer sending metadata requests every 100ms e.g. 2016-04-08 10:39:33,592 DEBUG [kafka-producer-network-thread | phil-pa-1] org.apache.kafka.clients.NetworkClient: Sending metadata request ClientRequest(expec