Re: Mirror maker doesn't replicate new topics

Could you let me know the process of reproducing this issue? Guozhang On Thu, Sep 5, 2013 at 5:04 PM, Rajasekar Elango wrote: > Yes guozhang > > Sent from my iPhone > > On Sep 5, 2013, at 7:53 PM, Guozhang Wang wrote: > > > Hi Rajasekar, > > > > Is auto.create.topics.enable set to true in your

Re: Mirror maker doesn't replicate new topics

This could be related to https://issues.apache.org/jira/browse/KAFKA-1030 Thanks, Jun On Thu, Sep 5, 2013 at 4:39 PM, Rajasekar Elango wrote: > We having issues that mirormaker not longer replicate newly created topics. > It continues to replicate data for existing topics and but new topics >

Re: Sometimes get no message streams in consumer

Could you reproduce this easily? Thanks, Jun On Thu, Sep 5, 2013 at 10:52 AM, Ian Friedman wrote: > It shouldn't be, no… it returns an ImmutableMap.. > > setTopicMap(ImmutableMap.of(KafkaLogQueuer.sKafkaDataLogPathsTopic, 1)); > > -- > Ian Friedman > > > On Wednesday, September 4, 2013 at 11:

Re: Mirror maker doesn't replicate new topics

Yes guozhang Sent from my iPhone On Sep 5, 2013, at 7:53 PM, Guozhang Wang wrote: > Hi Rajasekar, > > Is auto.create.topics.enable set to true in your target cluster? > > Guozhang > > > On Thu, Sep 5, 2013 at 4:39 PM, Rajasekar Elango > wrote: > >> We having issues that mirormaker not longer r

Re: Mirror maker doesn't replicate new topics

Hi Rajasekar, Is auto.create.topics.enable set to true in your target cluster? Guozhang On Thu, Sep 5, 2013 at 4:39 PM, Rajasekar Elango wrote: > We having issues that mirormaker not longer replicate newly created topics. > It continues to replicate data for existing topics and but new topics

Mirror maker doesn't replicate new topics

We having issues that mirormaker not longer replicate newly created topics. It continues to replicate data for existing topics and but new topics doesn't get created on target cluster. ConsumerOffsetTracker shows that new topics are successfully consumed and Lag is 0. But those topics doesn't get c

Re: Sometimes get no message streams in consumer

It shouldn't be, no… it returns an ImmutableMap.. setTopicMap(ImmutableMap.of(KafkaLogQueuer.sKafkaDataLogPathsTopic, 1)); -- Ian Friedman On Wednesday, September 4, 2013 at 11:40 PM, Jun Rao wrote: > What createMessageStreams() returns should match what's in the input. Is it > possible

Re: Kafka Monitoring

Thanks a lot Jun. This is very helpful. Thanks, Raja. On Thu, Sep 5, 2013 at 1:12 AM, Jun Rao wrote: > Updated the doc at http://kafka.apache.org/documentation.html#monitoring > > Hopefully that answers your questions. > > Thanks, > > Jun > > > On Tue, Sep 3, 2013 at 11:16 PM, Vadim Keylis >

Re: Sending huge binary files via Kafka?

It would be possible to modify an existing client implementation to use sendfile(2) to pass message contents from/to the filesystem rather than (pre-)allocating send&receive buffers, Thus providing zero-copy file transfer over Kafka. I believe this is how the broker is implemented. Regards, Magnus