TR: reseting dirty offset

2019-03-10 Thread adrien ruffie
Anyone have a idea ? very strange I though you'd already come across the case... De : adrien ruffie Envoyé : vendredi 8 mars 2019 10:49 À : users@kafka.apache.org Objet : reseting dirty offset Hello all, This morning I got the following error: [2019-03-0

Re: question about kafka topic

2019-03-10 Thread Matthias J. Sax
Writes, must always go to the partition leader, ie, if an error occurs, the message cannot simply be delivered to a different broker. However, if a broker is in bad shape, it could get leaderhship revoked and a healthy broker would get leadership assigned. The producer can detect this automaticall

RE: question about kafka topic

2019-03-10 Thread K R, Rakesh
Sorry I did not mention one point. I am seeing this error on consumer side. -Original Message- From: Matthias J. Sax [mailto:matth...@confluent.io] Sent: Sunday, March 10, 2019 11:01 PM To: users@kafka.apache.org Subject: Re: question about kafka topic Writes, must always go to the parti

group id issue on kafka using C library

2019-03-10 Thread K R, Rakesh
Hi, I am completely new to this kafka. I was just playing around with example code provided in the repo https://github.com/edenhill/librdkafka/tree/master/examples. I have encountered an issue where rd_kafka_poll_set_consumer() api throws me an error saying Local: Unknown group (RD_KAFKA_RESP_ERR

Re: group id issue on kafka using C library

2019-03-10 Thread Akshata akshu
Hi, Group id is not mandatory. If you create a consumer without the group id random group id is assigned for the consumer. On Sun 10 Mar, 2019 11:08 pm K R, Rakesh, wrote: > Hi, > I am completely new to this kafka. > I was just playing around with example code provided in the repo > https://gith

RE: group id issue on kafka using C library

2019-03-10 Thread K R, Rakesh
Then any idea on why I am seeing this error RD_KAFKA_RESP_ERR__UNKNOWN_GROUP without group id? -Original Message- From: Akshata akshu [mailto:akshataaksh...@gmail.com] Sent: Sunday, March 10, 2019 11:20 PM To: users@kafka.apache.org Subject: Re: group id issue on kafka using C library H

Re: group id issue on kafka using C library

2019-03-10 Thread Magnus Edenhill
You need to explicitly set the "group.id" configuration property (with rd_kafka_conf_set()) when using the high-level consumer. Den sön 10 mars 2019 kl 18:57 skrev K R, Rakesh : > Then any idea on why I am seeing this error > RD_KAFKA_RESP_ERR__UNKNOWN_GROUP without group id? > > -Original Me

Re: question about kafka topic

2019-03-10 Thread Matthias J. Sax
What error do you exactly see? On 3/10/19 10:35 AM, K R, Rakesh wrote: > Sorry I did not mention one point. I am seeing this error on consumer side. > > -Original Message- > From: Matthias J. Sax [mailto:matth...@confluent.io] > Sent: Sunday, March 10, 2019 11:01 PM > To: users@kafka.ap

Re: Kafka 2.0: High level consumer is slow to deal with SSL certification expiration

2019-03-10 Thread Henry Cai
I looked the latest code (Kafka 2.2.0) code in NetworkClient.java, I don't see any changes in the related code, I believe the problem also existed there. Created this JIRA to track the issue: https://issues.apache.org/jira/browse/KAFKA-8089 On Thu, Mar 7, 2019 at 11:39 PM Ismael Juma wrote: > H

No backoff on producer sending from MirrorMaker on metadata error

2019-03-10 Thread Henry Cai
Version: Kafka 2.0.0 (Believe the problem also exists on 2.2.0) The producer thread in MirrorMaker will go repeatedly sending loop without any backoffs when encountered metadata errors. For example, the following error messages will repeat itself for hundred times with very small interval (100ms)