Re: NPE in debug logging statement in kafka new producer

2014-12-28 Thread Bae, Jae Hyeon
I forgot to mention I was building with kafka-clients-0.8.2-beta. To reproduce this problem, I cloned kafka github repo and changed the source tree to the tag:0.8.2-beta and modified the dependency in my IDE from kafka-clients-0.8.2-beta to the source tree with tag:0.8.2-beta but I couldn't reprod

kafka consumer pull

2014-12-28 Thread panqing...@eefung.com
HI, I recently learning Kafka, there are several problems 1, ActiveMQ is broker push message, consumer established the messagelistener gets the message, but the message in Kafka are consumer pull from broker, Timing acquisition from brokeror can build the listener on the broker? 2, I no

Re: csv files to kafka

2014-12-28 Thread Joe Stein
In that project the protobuf https://github.com/stealthly/f2k/blob/master/src/main/proto/FileType.proto is compiled/generated in the gradle task using the plugin https://github.com/stealthly/f2k/blob/master/build.gradle#L17 You need to have protobuf https://github.com/google/protobuf/ installed an

Re: Trying to figure out kafka latency issues

2014-12-28 Thread Rajiv Kurian
Hi all, Bumping this up, in case some one has any ideas. I did yet another experiment where I create 4 producers and stripe the send requests across them in a manner such that any one producer only sees 256 partitions instead of the entire 1024. This seems to have helped a bit, and though I still

Re: NPE in debug logging statement in kafka new producer

2014-12-28 Thread Neha Narkhede
This is a bug. Would you mind filing a JIRA? Also feel free to upload a patch. On Sat, Dec 27, 2014 at 7:25 PM, Bae, Jae Hyeon wrote: > Hi > > While I am testing kafka java producer, I saw the following NPE > > SLF4J: Failed toString() invocation on an object of type > [org.apache.kafka.common.C