Re: EventHandler in 0.8

2013-08-02 Thread Chris Hogue
Hi Jun. Yeah, I assumed this was a little-used hook so wasn't altogether surprised it's not supported in 0.8. For our current problem we'll have to dig a little further on how to approach it. Batching and compressing before sending to the producer is straight-forward enough, but the semantic parti

Re: EventHandler in 0.8

2013-08-02 Thread Jun Rao
Chris, Thanks for bringing up this part. Yes, in 0.8, we don't really support a custom event handler. This is because (1) the producer send logic is a bit more complicated since it has to issue metadata requests whenever leaders change; (2) we are not aware of too many use cases of custom event ha

EventHandler in 0.8

2013-08-02 Thread Chris Hogue
We're a heavy 0.7 user and are now digging into 0.8 for some new projects. One of the features we used in 0.7 appears to be different and not clearly supported in 0.8. We use the EventHandler plug-point in 0.7, specifically to do custom batching before the messages are actually sent to the broker.