How to prevent custom Partitioner from increasing the number of producer's requests?

2015-06-02 Thread Sebastien Falquier
Hi guys, I am new to Kafka and I am facing a problem I am not able to sort out. To smooth traffic over all my brokers' partitions, I have coded a custom Paritioner for my producers, using a simple round robin algorithm that jumps from a partition to another on every batch of messages (correspondi

Re: How to prevent custom Partitioner from increasing the number of producer's requests?

2015-06-02 Thread Sebastien Falquier
ld be an off by 1 error, with your modulo calculation? > Perhaps you need to use '% 0' instead of '% 1' there? > > Jason > > > > On Tue, Jun 2, 2015 at 3:35 AM, Sebastien Falquier < > sebastien.falqu...@teads.tv> wrote: > > > Hi guys, >

Re: How to prevent custom Partitioner from increasing the number of producer's requests?

2015-06-03 Thread Sebastien Falquier
ld producer has 10 min sticky partition behavior while the new > producer does not. > > Thanks, > > Jiangjie (Becket) Qin > > On 6/2/15, 11:58 PM, "Sebastien Falquier" > wrote: > > >Hi Jason, > > > >The default partitioner does not make the jo

Re: How to prevent custom Partitioner from increasing the number of producer's requests?

2015-06-11 Thread Sebastien Falquier
t;Producer[Integer,String](prodConfig) > > > > > >How can I know which producer I am using? And what is the behavior of > the > > >new producer? > > > > > >Thanks, > > >Sébastien > > > > > > > > >2015-06-03 20