Re: Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2023-03-26 Thread hudeqi
Is there any more attention to this KIP? bump this thread. Best, hudeqi "hudeqi" <16120...@bjtu.edu.cn>写道: > Hello, have any mates who have discussed it before seen it? Also welcome new > mates to discuss together. > > "hudeqi" <16120...@bjtu.edu.cn>写道: > > Long time no see, this issue has bee

Re: Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2023-03-08 Thread hudeqi
I repost the newly changed KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-842%3A+Add+richer+group+offset+reset+mechanisms "hudeqi" <16120...@bjtu.edu.cn>写道: > Hello, have any mates who have discussed it before seen it? Also welcome new > mates to discuss together. > > "hudeqi" <1612

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2023-03-08 Thread hudeqi
Hello, have any mates who have discussed it before seen it? Also welcome new mates to discuss together. "hudeqi" <16120...@bjtu.edu.cn>写道: > Long time no see, this issue has been discussed for a long time, now please > allow me to summarize this issue, and then everyone can help to see which >

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2023-03-06 Thread hudeqi
Long time no see, this issue has been discussed for a long time, now please allow me to summarize this issue, and then everyone can help to see which direction this issue should go in? There are two problems to be solved by this kip: 1. Solve the problem that when the client configures the "auto

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-13 Thread Guozhang Wang
>> On Wed, Jun 29, 2022 at 4:57 AM David Jacot >> wrote: >> > >> >> > >>> Thanks for the KIP. >> > >>> >> > >>> I read it and I am also worried by the complexity of the new

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-13 Thread Guozhang Wang
2 à 02:25, Matthias J. Sax a > écrit : > > >>> > > >>>> Thanks for the KIP. > > >>>> > > >>>> I don't think I fully digested the proposal yet, but my first > reaction > > >>>> is: this is quite compl

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-08 Thread hudeqi
t;>>> > >>>> The problem at hand (as I understand it from the Jira) is a real one, > >>>> but I am wondering if it would be something that should be addressed by > >>>> the application? If you pass in strategy `none`, and a new partition is > >>>> added, you can react to it by custom code. For regular startup you can > >>>> still go with "latest" to avoid reprocessing the history. > >>>> > >>>> Adding "latest/earliest_on_start" seems useful, as it seems to also > >>>> address https://issues.apache.org/jira/browse/KAFKA-3370 > >>>> > >>>> > >>>> -Matthias > >>>> > >>>> > >>>> On 6/7/22 12:55 AM, hudeqi wrote: > >>>>> I think so too, what about Guozhang Wang and Luke Chen? Can I initiate > >>> a > >>>> voting process? > >>>>> > >>>>> Best, > >>>>> hudeqi > >>>>> > >>>>> > -原始邮件- > >>>>> > 发件人: "邓子明" > >>>>> > 发送时间: 2022-06-07 10:23:37 (星期二) > >>>>> > 收件人: dev@kafka.apache.org > >>>>> > 抄送: > >>>>> > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset > >>> mechanisms > >>>>> > > >>>>> > >>>> > >>>

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-07 Thread Matthias J. Sax
o avoid reprocessing the history. Adding "latest/earliest_on_start" seems useful, as it seems to also address https://issues.apache.org/jira/browse/KAFKA-3370 -Matthias On 6/7/22 12:55 AM, hudeqi wrote: I think so too, what about Guozhang Wang and Luke Chen? Can I initiate a voting proce

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-01 Thread hudeqi
he history. > > > > > > Adding "latest/earliest_on_start" seems useful, as it seems to also > > > address https://issues.apache.org/jira/browse/KAFKA-3370 > > > > > > > > > -Matthias > > > > > > > > > On 6/7/22 12:55 AM, hudeqi wrote: > > > > I think so too, what about Guozhang Wang and Luke Chen? Can I initiate > > a > > > voting process? > > > > > > > > Best, > > > > hudeqi > > > > > > > > > -原始邮件- > > > > > 发件人: "邓子明" > > > > > 发送时间: 2022-06-07 10:23:37 (星期二) > > > > > 收件人: dev@kafka.apache.org > > > > > 抄送: > > > > > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset > > mechanisms > > > > > > > > > > > > > >

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-01 Thread hudeqi
gt; > > > -Matthias > > > > > > On 6/7/22 12:55 AM, hudeqi wrote: > > > I think so too, what about Guozhang Wang and Luke Chen? Can I initiate a > > voting process? > > > > > > Best, > > > hudeqi > > > > > > > -原始邮件- > > > > 发件人: "邓子明" > > > > 发送时间: 2022-06-07 10:23:37 (星期二) > > > > 收件人: dev@kafka.apache.org > > > > 抄送: > > > > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms > > > > > > > > >

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-07-01 Thread hudeqi
" seems useful, as it seems to also > address https://issues.apache.org/jira/browse/KAFKA-3370 > > > -Matthias > > > On 6/7/22 12:55 AM, hudeqi wrote: > > I think so too, what about Guozhang Wang and Luke Chen? Can I initiate a > > voting process? > &g

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-06-29 Thread Matthew Howlett
2 12:55 AM, hudeqi wrote: > > > I think so too, what about Guozhang Wang and Luke Chen? Can I initiate > a > > voting process? > > > > > > Best, > > > hudeqi > > > > > > > -原始邮件- > > > > 发件人: "邓子明" > > > > 发送时间: 2022-06-07 10:23:37 (星期二) > > > > 收件人: dev@kafka.apache.org > > > > 抄送: > > > > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset > mechanisms > > > > > > > > > >

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-06-29 Thread David Jacot
nk so too, what about Guozhang Wang and Luke Chen? Can I initiate a > voting process? > > > > Best, > > hudeqi > > > > > -----原始邮件----- > > > 发件人: "邓子明" > > > 发送时间: 2022-06-07 10:23:37 (星期二) > > > 收件人: dev@kafka.apache.org > > > 抄送: > > > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms > > > > > >

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-06-28 Thread Matthias J. Sax
n? Can I initiate a voting process? Best, hudeqi > -原始邮件- > 发件人: "邓子明" > 发送时间: 2022-06-07 10:23:37 (星期二) > 收件人: dev@kafka.apache.org > 抄送: > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms >

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-06-07 Thread hudeqi
I think so too, what about Guozhang Wang and Luke Chen? Can I initiate a voting process? Best, hudeqi > -原始邮件- > 发件人: "邓子明" > 发送时间: 2022-06-07 10:23:37 (星期二) > 收件人: dev@kafka.apache.org > 抄送: > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms >

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-06-06 Thread 邓子明
i <16120...@bjtu.edu.cn> > > 发送时间: 2022-05-30 15:33:45 (星期一) > > 收件人: dev@kafka.apache.org > > 抄送: > > 主题: Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms > > > > Thank you for your reply. > > According to the current implementatio

Re: Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-30 Thread hudeqi
送时间: 2022-05-30 15:33:45 (星期一) > 收件人: dev@kafka.apache.org > 抄送: > 主题: Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms > > Thank you for your reply. > According to the current implementation in pull request, it may not be possible to directly remove the enum

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-30 Thread hudeqi
n is disabled default, that is to say, when out-of-range, reset strategy is performed according to the main strategy (auto.offset.reset). > > > > > > > >> -原始邮件- > >> 发件人: "deng ziming" > >> 发送时间: 2022-05-27 16:02:53 (星期五) > &

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-29 Thread deng ziming
kip-842. > > > > > 4. The meaning of nearest.offset.reset has been clearly expressed in point 2, > this configuration is disabled default, that is to say, when out-of-range, > reset strategy is performed according to the main strategy > (auto.offset.reset). > >

Re: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-27 Thread hudeqi
ategy is performed according to the main strategy (auto.offset.reset). > -原始邮件- > 发件人: "deng ziming" > 发送时间: 2022-05-27 16:02:53 (星期五) > 收件人: dev@kafka.apache.org > 抄送: > 主题: Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms > > Thank yo

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-27 Thread deng ziming
Thank you for this KIP, the motivation makes sense to me, left some questions: 1. If strategy=safe_latest and there is not committed offset, we have 2 choices based on whether the group is started newly, can you elaborate on how can we decide the group is started newly? It would be clear. 2. If

Re: [DISCUSS] KIP-842: Add richer group offset reset mechanisms

2022-05-25 Thread 胡德祺
Hi all, Why is no one talking about this? best hudeqi 2022-05-23 17:45:53"胡德祺" <16120...@bjtu.edu.cn>写道: Hi all, I have written a new KIPto add some group offset reset mechanisms. Please take a look here: https://cwiki.apache.org/confluence/x/xhyhD besthudeqi