These monitors are not consuming / committing offsets as part of the
group, are they?
Normally that should not be the case (e.g. the consumer group command tool
retrieves the current position and the log end offset but it doesn't
affect how long the group lives).
Only consumers that commit offsets (automatically or manually) will extend
the lifecycle of a group.
--Vahid
From: "ÅíÅô(Peyton)" <p...@webull.com>
To: Vahid S Hashemian <vahidhashem...@us.ibm.com>
Cc: "彭鹏" <p...@webull.com>, users@kafka.apache.org
Date: 08/13/2018 07:11 PM
Subject: Re: Question how to drop a unused group id?
Yes it is clearly there is no process committing offset for those group
id, but because of monitor(kafka manager and self coding monitor) always
try to detect the latest offset, does this effect the remove action?
Regards,
Peyton
湖南福米信息科技有限责任公司 Hunan Fumi Financial Technology Co., Ltd.
===========================================================
地址 / Add ：湖南省长沙市高新区岳麓西大道588号芯城科技园3栋5F (410000)
5/F, Building 3, Xincheng Science & Technology
Park
No.588 Yuelu West Ave, Changsha 410000, Hunan,
P.R.China
手机 / Cell : (86) 150 2113 9776
邮箱 / Mail : p...@webull.com
===========================================================
在 2018年8月14日，上午12:25，Vahid S Hashemian <vahidhashem...@us.ibm.com>
写道：
It should be automatically removed if there is no offset commit in the
group for 24 hours.
Are you sure there is no process committing offset for the group?
If kafka-manager lists them they're probably still there.
You can also use the consumer group command to check this:
> bin/kafka-consumer-groups.sh --bootstrap-server [broker]:9092 --list
--Vahid
From: "ÅíÅô(Peyton)" <p...@webull.com>
To: Vahid S Hashemian <vahidhashem...@us.ibm.com>
Cc: users@kafka.apache.org, "彭鹏" <p...@webull.com>
Date: 08/13/2018 09:18 AM
Subject: Re: Question how to drop a unused group id?
Thanks! Hmmm.. the last question, then by default, the unused group id was
already removed by this setting?
We use kafka-manager to manage the kafka cluster, and we can still see the
expired group ids, as we talked previously, it dos not exists actually,
right?
Best Regards,
Peyton
湖南福米信息科技有限责任公司 Hunan Fumi Financial Technology Co., Ltd.
===========================================================
地址 / Add ：湖南省长沙市高新区岳麓西大道588号芯城科技园3栋5F (410000)
5/F, Building 3, Xincheng Science & Technology Park
No.588 Yuelu West Ave, Changsha 410000, Hunan,
P.R.China
手机 / Cell : (86) 150 2113 9776
邮箱 / Mail : p...@webull.com
===========================================================
在 2018年8月14日，上午12:05，Vahid S Hashemian <vahidhashem...@us.ibm.com>
写道：
If you did not set the config, the default will be used.
For your version of Kafka (0.10.2.1) the default is 1 day:
https://github.com/apache/kafka/blob/0.10.2.1/core/src/main/scala/kafka/server/KafkaConfig.scala#L152
--Vahid
From: "ÅíÅô(Peyton)" <p...@webull.com>
To: Vahid S Hashemian <vahidhashem...@us.ibm.com>
Cc: users@kafka.apache.org, "彭鹏" <p...@webull.com>
Date: 08/13/2018 08:56 AM
Subject: Re: Question how to drop a unused group id?
Ok, thanks again for the help, and another question, by default we did not
set the config item, so does not it take effect with the default
situation?
I just searched the code with the configuration key “
offset.retention.minutes", but I can get any reference, be changed?
Best Regards,
Peyton
湖南福米信息科技有限责任公司 Hunan Fumi Financial Technology Co., Ltd.
===========================================================
地址 / Add ：湖南省长沙市高新区岳麓西大道588号芯城科技园3栋5F (410000)
5/F, Building 3, Xincheng Science & Technology Park
No.588 Yuelu West Ave, Changsha 410000, Hunan,
P.R.China
手机 / Cell : (86) 150 2113 9776
邮箱 / Mail : p...@webull.com
===========================================================
在 2018年8月13日，下午11:52，Vahid S Hashemian <vahidhashem...@us.ibm.com>
写道：
Hi Peyton,
Yes, if you'd like to change the value a broker restart is required for
the change to take effect.
--Vahid
From: "ÅíÅô(Peyton)" <p...@webull.com>
To: Vahid S Hashemian <vahidhashem...@us.ibm.com>
Cc: users@kafka.apache.org, "彭鹏" <p...@webull.com>
Date: 08/13/2018 08:49 AM
Subject: Re: Question how to drop a unused group id?
Hi Vahid,
Thank you very much for the reply, we use the kafka ver 2.11-0.10.2.1.
So when I apply the "offset.retention.minutes" to the system that request
a restart to be effected?
Best Regards,
Peyton
湖南福米信息科技有限责任公司 Hunan Fumi Financial Technology Co., Ltd.
===========================================================
地址 / Add ：湖南省长沙市高新区岳麓西大道588号芯城科技园3栋5F (410000)
5/F, Building 3, Xincheng Science & Technology Park
No.588 Yuelu West Ave, Changsha 410000, Hunan,
P.R.China
手机 / Cell : (86) 150 2113 9776
邮箱 / Mail : p...@webull.com
===========================================================
在 2018年8月13日，下午11:43，Vahid S Hashemian <vahidhashem...@us.ibm.com>
写道：
Hi Peyton,
What version of Kafka are you using?
Starting from version 1.1.0 there is a DELETE_GROUP API:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-229%3A+DeleteGroups+API
You can also use the consumer group command with `--delete` to delete a
group.
For prior versions, the safest option would be to wait for
`offset.retention.minutes` until all group offsets are expired.
--Vahid
From: "ÅíÅô(Peyton)" <p...@webull.com>
To: users@kafka.apache.org
Cc: "彭鹏" <p...@webull.com>
Date: 08/13/2018 08:12 AM
Subject: Question how to drop a unused group id?
Hi kafka team,
I have an issue about drop the unused group id which is created with the
new consumer api, but I found no way to process it, can you please give mi
a hint how to do it?
Thank you very much.
Regards,
Peyton
湖南福米信息科技有限责任公司 Hunan Fumi Financial Technology Co., Ltd.
===========================================================
地址 / Add ：湖南省长沙市高新区岳麓西大道588号芯城科技园3栋5F (410000)
5/F, Building 3, Xincheng Science & Technology Park
No.588 Yuelu West Ave, Changsha 410000, Hunan,
P.R.China
手机 / Cell : (86) 150 2113 9776
邮箱 / Mail : p...@webull.com
===========================================================
