Re: how to find out the group coordinator in kafka for a given topic?

2017-08-25 Thread Yuanjia
A groupcoordinator is relating to a groupId from my understanding. "AdminClient.findCoordinator" can find the groupcoordinator for a given groupId. YuanjiaLi From: Devendar Rao Date: 2017-08-25 13:37 To: users Subject: how to find out the group coordinator in kafka for a given topic?

how to find the producer for a given topic

2017-08-25 Thread Yuanjia
Hi all, We can use kafka-consumer-groups.sh to find group owner. Is there any tools can find the producer for a given topic? Thanks. YuanjiaLi

Kafka - Consumer Offset Reset Automatically

2017-08-25 Thread Daniccan VP
Hi Users, While using Apache Kafka with a Java API High Level Consumer, I get the following error sometimes, WARNpool-1-thread-4 Auto-commit of offsets {my_topic-2=OffsetAndMetadata{offset=53847, metadata=''}} failed for group my_consumer_group: Offset commit failed with a retriable exception. Yo

Re: kafka in unrecoverable state

2017-08-25 Thread Murad Mamedov
At the time of first time it occurred, all replicas was in sync. But after restart of clients and brokers, exception started to occur immediately, and replicas becoming out of sync. As explained in the issue, bug related to configuration and timing of records. On Fri, Aug 25, 2017 at 10:31 AM, Dan

Error on Kafka Connect side || HDFS Connector

2017-08-25 Thread Nishant Verma
Hello All We are using Kafka Connect to pull records from our Kafka topics to HDFS. We have a working setup which has giving accurate results last week and before that with no data loss for 8-9 billion records. Our source produces some 18 million records per hour. We see below error at times in t

Re: Kafka Streams: Pseudo Wallclock Punctuate

2017-08-25 Thread Matthias J. Sax
Eli, One think you could do, is to send "tick tuples" through your topology and use WallclockTimestampExtractor. It's not a nice solution, but I don't have any better idea atm. -Matthias On 8/24/17 9:37 PM, Eli Jordan wrote: > Update on this. Modifying the state store on another thread actually

Re: Kafka Streams: Pseudo Wallclock Punctuate

2017-08-25 Thread Eli Jordan
Thanks Matthias Yeah I also had this idea, and started implementing it. Hopefully it works out. Thanks Eli > On 26 Aug 2017, at 04:25, Matthias J. Sax wrote: > > Eli, > > One think you could do, is to send "tick tuples" through your topology > and use WallclockTimestampExtractor. It's not a n