Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-15 Thread Vahid S Hashemian
better fit. If there is no additional comment/feedback I'll start a vote soon. Thanks. --Vahid From: "Vahid S Hashemian" To: dev@kafka.apache.org Date: 08/07/2018 01:58 PM Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-07 Thread Vahid S Hashemian
AM Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets Hi Jason, Thanks for the feedback. Your suggestions make sense to me. I think I'm more in favor of adding this info to kafka-topic tool (through another KIP) since it is not consumer group specific

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-07-03 Thread Vahid S Hashemian
d From: Jason Gustafson To: dev Date: 06/28/2018 02:39 PM Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets Hey Gwen/Vahid, I think that use case makes sense, but isn't it a little odd to go through the consumer group tool? I would

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-28 Thread Jason Gustafson
; > > > > > From: James Cheng > > To: dev@kafka.apache.org > > Date: 06/27/2018 09:13 PM > > Subject:Re: [DISCUSS] KIP-325: Extend Consumer Group Command to > > Show Beginning Offsets > > > > > > > > The “Motivation” sect

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-28 Thread Vahid S Hashemian
Group Command to Show Beginning Offsets The “Motivation” section of the KIP says that the starting offset will be useful but doesn’t say why. Can you add a use-case or two to describe how it will be useful? In our case (see https://github.com/wushujames/kafka-utilities/blob/master

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-27 Thread James Cheng
The “Motivation” section of the KIP says that the starting offset will be useful but doesn’t say why. Can you add a use-case or two to describe how it will be useful? In our case (see https://github.com/wushujames/kafka-utilities/blob/master/ConsumerGroupLag/README.md), we found the starting o

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-27 Thread Gwen Shapira
t; "partition > > > size" column. > > > > > > --Vahid > > > > > > > > > > > > > > > From: Ted Yu > > > To: dev@kafka.apache.org > > > Date: 06/26/2018 06:21 PM > > > Subject:Re

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-27 Thread Jason Gustafson
> > From: Ted Yu > > To: dev@kafka.apache.org > > Date: 06/26/2018 06:21 PM > > Subject:Re: [DISCUSS] KIP-325: Extend Consumer Group Command to > > Show Beginning Offsets > > > > > > > > nit: > > > > bq. leaving this

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Gwen Shapira
kafka.apache.org > Date: 06/26/2018 06:21 PM > Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group Command to > Show Beginning Offsets > > > > nit: > > bq. leaving this empty for compacted topics > > Some user(s) may be confused by empty partition size. How ab

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Vahid S Hashemian
Thanks for the feedback. The KIP is updated to also include a "partition size" column. --Vahid From: Ted Yu To: dev@kafka.apache.org Date: 06/26/2018 06:21 PM Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets nit: bq. le

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Ted Yu
for the feedback. > > Regarding the partition size, couldn't "end offset - start offset" be > > misleading for compacted topics? > > > > --Vahid > > > > > > > > > > From: Gwen Shapira > > To: dev > > Date: 06/

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Gwen Shapira
en, > > Thanks for the feedback. > Regarding the partition size, couldn't "end offset - start offset" be > misleading for compacted topics? > > --Vahid > > > > > From: Gwen Shapira > To: dev > Date: 06/26/2018 02:36 PM > Subject

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Vahid S Hashemian
Hi Gwen, Thanks for the feedback. Regarding the partition size, couldn't "end offset - start offset" be misleading for compacted topics? --Vahid From: Gwen Shapira To: dev Date: 06/26/2018 02:36 PM Subject: Re: [DISCUSS] KIP-325: Extend Consumer Group C

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Gwen Shapira
Small suggestion: you can also add a "partition size" column - difference between log-end and log-start. We've had users ask for this. On Tue, Jun 26, 2018 at 2:34 PM, Gwen Shapira wrote: > This will be useful! Thank you :) > > On Tue, Jun 26, 2018 at 11:23 AM, Vahid S Hashemian < > vahidhashem.

Re: [DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Gwen Shapira
This will be useful! Thank you :) On Tue, Jun 26, 2018 at 11:23 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi everyone, > > I have created a trivial KIP to improve the offset reporting of the > consumer group command: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 325

[DISCUSS] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-06-26 Thread Vahid S Hashemian
Hi everyone, I have created a trivial KIP to improve the offset reporting of the consumer group command: https://cwiki.apache.org/confluence/display/KAFKA/KIP-325%3A+Extend+Consumer+Group+Command+to+Show+Beginning+Offsets Looking forward to your feedback! Thanks. --Vahid