Re: Kafka 0.9.0 New Java Consumer API fetching duplicate records

2015-12-22 Thread Jason Gustafson
I took your demo code and ran it locally. So far I haven't seen any duplicates. In addition to the output showing duplicates, it might be helpful to include your producer code. Thanks, Jason On Tue, Dec 22, 2015 at 11:02 AM, Jason Gustafson wrote: > Hey Pradeep, > > Can you include the output f

Re: 0.9 consumer beta?

2015-12-22 Thread Guozhang Wang
Allen, By "beta quality" we meant to say that it is not used in production yet as we know of, and its public APIs may have minor changes in future 0.9.0.1 release. But if you need any new features of the 0.9.0.0 release like security I would recommend you to start trying it out. Thanks, Guozhang

Re: Kafka 0.9.0 New Java Consumer API fetching duplicate records

2015-12-22 Thread Jason Gustafson
Hey Pradeep, Can you include the output from one of the ConsumerDemo runs? -Jason On Mon, Dec 21, 2015 at 9:47 PM, pradeep kumar wrote: > Can someone please help me on this. > > http://stackoverflow.com/questions/34405124/kafka-0-9-0-new-java-consumer-api-fetching-duplicate-records > > Thanks,

Rebalancing in Kafka 0.8.2.2

2015-12-22 Thread Deepti Jindal -X (djindal - ARICENT TECHNOLOGIES MAURIITIUS LIMITED at Cisco)
Hi, I am using kafka 0.8.2.2 for developing an application for my company. We will be using High Level Consumer API for the same. There is one point which I want to confirm in this regard, that In Kafka 0.8.2.2 there is no callback or any mechanism available which will tell the consumer that a r

Re: Exceptions when programmatically start multiple kafka brokers

2015-12-22 Thread Guozhang Wang
Siyuan, Does both of them have broker id = 0? Guozhang On Mon, Dec 21, 2015 at 3:30 PM, hsy...@gmail.com wrote: > I'm trying to start 2 brokers in my kafka ingestion unit test and I got > exception > > javax.management.InstanceAlreadyExistsException: > kafka.server:type=app-info,id=0 > at

0.9 consumer beta?

2015-12-22 Thread allen chan
In the documentation it says the new consumer is considered beta quality. I cannot find what is beta about it. Stability? Performance? Can someone clarify? 3.3.2 New Consumer Configs Since 0.9.0.0 we have been working on a replacement f

Re: Measuring Kafka Producer request latency when it is less than 1ms

2015-12-22 Thread Helleren, Erik
For some high performance environments, I would like to see microsecond or nanosecond precision on metrics whenever possible. Even better would be some sort of histogram of individual events so we could see the variability. On 12/21/15, 9:27 PM, "Alexey Pirogov" wrote: >Ismael, thanks for reply

Re: Consumer group disappears and consumers loops

2015-12-22 Thread Rune Sørensen
Hi, Sorry for the long delay in replying. As for your questions: No we are not using SSL. The problem went away for Martin when he was running against his kafka instance locally on his development machine, but we are still seeing the issue when we run it in our testing environment, where the brok