couldn't reproduce/confirm the issue with my test. send 6 million msgs from 6 instances. got 6 million callbacks.
this could be some metric issues. On Mon, Feb 9, 2015 at 8:23 PM, Steven Wu <stevenz...@gmail.com> wrote: > I don't have strong evidence that this is a bug yet. let me write some > test program and see if I can confirm/reproduce the issue. > > On Mon, Feb 9, 2015 at 7:59 PM, Jay Kreps <jay.kr...@gmail.com> wrote: > >> Hmm, that does sound like a bug, we haven't seen that. How easy is it to >> reproduce this? >> >> -Jay >> >> On Mon, Feb 9, 2015 at 5:19 PM, Steven Wu <stevenz...@gmail.com> wrote: >> >> > We observed some small discrepancy in messages sent per second reported >> at >> > different points. 1) and 4) matches very close. 2) and 3) matches very >> > close but are about *5-6% lower* compared to 1) and 4). >> > 1) send attempt from producer >> > 2) send success from producer >> > 3) record-send-rate reported by kafka producer >> > 4) MessagesInPerSecond reported by kafka broker >> > >> > note that send success for 2) is incremented when onCompletion is called >> > without error/exception). there is also a send error count when >> > onCompletion is called with error. it is always zero. >> > >> > that's why I am wondering whether there are some callback misses? >> > >> > some info about the setup >> > * producer: 0.8.2-beta >> > * broker: 0.8.1.1 >> > * acks=1 >> > >> > Thanks, >> > Steven >> > >> > >
