Re: Better strategy for sending a message to multiple topics

2015-12-20 Thread Abel .
Hi, Jens, I would do it that way but different queues contain different contents. That's why I need more than a single queue to solve my problem. However, I have a hierarchical structure of queues (like a tree or forest) and when you push a message to a queue I need to make it available to all the

Re: Better strategy for sending a message to multiple topics

2015-12-20 Thread Dong Lin
Did you try asynchronous produce? That should provide better performance because asynchronous produce doesn't block waiting for response. BTW, what is your ack setting for producer? Dong On Fri, Dec 18, 2015 at 1:16 PM, Abel . wrote: > Hi, > > I have this scenario where I need to send a messag

Re: Better strategy for sending a message to multiple topics

2015-12-18 Thread Jens Rantil
Hi, Why don't your consumers instead subscribe to a single topic used to broadcast to all of them? That way your consumers and producer will be much simpler. Cheers, Jens – Skickat från Mailbox On Fri, Dec 18, 2015 at 4:16 PM, Abel . wrote: > Hi, > I have this scenario where I need

Better strategy for sending a message to multiple topics

2015-12-18 Thread Abel .
Hi, I have this scenario where I need to send a message to multiple topics. I create a single KafkaProducer, prepare the payload and then I call the send method of the producer for each topic with the correspoding ProducerRecord for the topic and the fixed message. However, I have noticed that thi