Re: MirrorMaker - Not consuming from all partitions

2015-09-11 Thread Craig Swift
Scary but thanks! :) We'll start digging into the network and see if we can find a smoking gun. Appreciate the response, thanks again. Craig J. Swift Software Engineer - Data Pipeline ReturnPath Inc. Work: 303-999-3220 Cell: 720-560-7038 On Fri, Sep 11, 2015 at 11:29 AM, Steve Miller wrote: >

Re: MirrorMaker - Not consuming from all partitions

2015-09-11 Thread Steve Miller
I have a vague feeling that I've seen stuff like this when the network on the broker that's disappearing is actually unreachable from time to time -- though I'd like to believe that's not such an issue when talking to AWS (though there could be a lot of screwed-up Internet between you and it,

Re: MirrorMaker - Not consuming from all partitions

2015-09-11 Thread Craig Swift
Just wanted to bump this again and see if the community had any thoughts or if we're just missing something stupid. For added context the topic we're reading from has 24 partitions and we see roughly 15k messages per minute. As I mentioned before the throughput seems fine, but I'm not entirely sure