Re: New async producer NetworkClient endlessly trying to fetch metadata for deleted topics

2016-04-01 Thread Stevo Slavić
Thanks for sharing Ismael! On Fri, Apr 1, 2016 at 6:24 PM, Ismael Juma wrote: > See: > > https://github.com/apache/kafka/pull/645 > https://github.com/apache/kafka/pull/735 > > Ismael > > On Fri, Apr 1, 2016 at 5:04 PM, Stevo Slavić wrote: > > > Correction, it's much more often logging these wa

Re: New async producer NetworkClient endlessly trying to fetch metadata for deleted topics

2016-04-01 Thread Ismael Juma
See: https://github.com/apache/kafka/pull/645 https://github.com/apache/kafka/pull/735 Ismael On Fri, Apr 1, 2016 at 5:04 PM, Stevo Slavić wrote: > Correction, it's much more often logging these warnings - every 100ms. > Current workaround is to regularly deploy fresh instance of app using > K

Re: New async producer NetworkClient endlessly trying to fetch metadata for deleted topics

2016-04-01 Thread Stevo Slavić
Correction, it's much more often logging these warnings - every 100ms. Current workaround is to regularly deploy fresh instance of app using KafkaProducer, or recreate KafkaProducer instances, so that cache of topics/partitions in it gets invalidated, cleared from deleted topics. On Fri, Apr 1, 20

New async producer NetworkClient endlessly trying to fetch metadata for deleted topics

2016-04-01 Thread Stevo Slavić
Hello Apache Kafka community, With kafka-clients 0.9.0.1, async producer doesn't seem to handle deleted topics well. If I create a topic, publish few messages to it, and delete it, KafkaProducer instance and underlying NetworkClient which was used to publish to that topic, will endlessly every 10