Re: no exceptions when producer send messages to a opened port that is not a broker

2013-01-21 Thread Helin Xiang
Thanks. I am really looking forward to version 0.8 release On Tue, Jan 22, 2013 at 1:17 PM, Jun Rao wrote: > This is true in 0.7 since the producer doesn't receive any ack. So, unless > the other side closes the socket on a wrong request, the producer client > won't know that sth is wrong on th

Re: no exceptions when producer send messages to a opened port that is not a broker

2013-01-21 Thread Jun Rao
This is true in 0.7 since the producer doesn't receive any ack. So, unless the other side closes the socket on a wrong request, the producer client won't know that sth is wrong on the server. In 0.8, the producer will wait for an ack from the broker and will timeout if no response is received. Th

Re: Consumer Question

2013-01-21 Thread Bo Sun
ok,Thanks ~ On Tue, Jan 22, 2013 at 12:08 AM, Jun Rao wrote: > Normally it shouldn't. If the problem shows up again, I suggest that you > use the ConsumerOffsetChecker tool to see if the consumer is indeed > lagging. > > Thanks, > > Jun > > On Mon, Jan 21, 2013 at 2:56 AM, Bo Sun wrote: > > > i

Re: Cross-site Kafka installation

2013-01-21 Thread Joel Koshy
We do mirroring across data-centers (but in the same continent). You should basically set a high fetch size and socket buffer size in such scenarios. In general, you should set a high value for the socket buffer size on the consumer configuration (socket.buffersize) and the source cluster's broker

Cross-site Kafka installation

2013-01-21 Thread Pablo Barrera González
Hello In my enterprise we are deploying an cross-site installation of Kakfa. One of the Kafka cluster is located in USA and one consumer is in Europe. Does anybody have experience in such an environment? Any comments on the configuration and best practices? Thanks in advance Pablo

Re: Non-blocking Kafka stream iterators

2013-01-21 Thread Jay Kreps
It's worth mentioning that we are interested in exploring potential generalizations of the producer and consumer API, but as a practical matter most of the committers are working on getting a stable 0.8 release out the door. So an improved consumer and producer api would be a 0.9 feature. If you h

java.lang.NoClassDefFoundError: Could not initialize class java.util.Currency

2013-01-21 Thread Brett Hoerner
Has anyone ever seen something like this on the Kafka (0.7.2) broker side? I'm running JDK7, and that class most definitely exists Once this started it just spammed non-stop (for everything each producer sent to the box, I think) and Kafka was totally wedged. I bounced and it came back online imme

Re: Consumer Question

2013-01-21 Thread Jun Rao
Normally it shouldn't. If the problem shows up again, I suggest that you use the ConsumerOffsetChecker tool to see if the consumer is indeed lagging. Thanks, Jun On Mon, Jan 21, 2013 at 2:56 AM, Bo Sun wrote: > it's not any exceptions. i found sth.today, "several days later " , it's > no data

Re: Non-blocking Kafka stream iterators

2013-01-21 Thread Jun Rao
No, but you can implement it in your application. Thanks, Jun On Sun, Jan 20, 2013 at 11:02 PM, navneet sharma < navneetsharma0...@gmail.com> wrote: > Is there any property to make consumer work for lets say only 10 mins (ie > some kind of timer) > So, i want to close the consumer after 10 mins

Re: Consumer Question

2013-01-21 Thread Bo Sun
it's not any exceptions. i found sth.today, "several days later " , it's no data to produce to kafka. but after several days . kafka get the new data. but cannot consume anything . is that ( no data days ) couse the problem? Thanks Eric On Mon, Jan 21, 2013 at 2:13 PM, Jun Rao wrote: > When