[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450387#comment-15450387 ] Eric Wasserman commented on KAFKA-1981: --- Opened new pull request at: h

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357222#comment-15357222 ] Eric Wasserman commented on KAFKA-1981: --- [~junrao] could you please take a loo

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345618#comment-15345618 ] Eric Wasserman commented on KAFKA-1981: --- [~ijuma] do you think you have a chanc

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325578#comment-15325578 ] Eric Wasserman commented on KAFKA-1981: --- [~ijuma] A new pull request is avail

[jira] [Comment Edited] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317588#comment-15317588 ] Eric Wasserman edited comment on KAFKA-1981 at 6/7/16 12:5

[jira] [Comment Edited] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317588#comment-15317588 ] Eric Wasserman edited comment on KAFKA-1981 at 6/7/16 12:5

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317588#comment-15317588 ] Eric Wasserman commented on KAFKA-1981: --- During the KIP-58 vote it was [sugge

RE: [VOTE] KIP-58 - Make Log Compaction Point Configurable

During the vote it was suggested the name of the property be changed from: log.cleaner.compaction.lag.ms to log.cleaner.compaction.delay.ms Note that this feature concerns controlling the portion of the head of the log (new messages go on the head) that will be left un-compacted (i.e. i

RE: [VOTE] KIP-58 - Make Log Compaction Point Configurable

Thanks everyone for voting. The vote passed with 5 binding +1's (Gwen, Jay, Ewen, Ismael, Jun) and with 9 nb's (Becket, James, Tom, Mnikumar, Ben, Grant, Joel, Eric) The discussion should move to KAFKA-1981

[VOTE] KIP-58 - Make Log Compaction Point Configurable

Hi, I would like to begin voting on KIP-58 - Make Log Compaction Point Configurable KIP-58 is here: < https://cwiki.apache.org/confluence/display/KAFKA/KIP-58+-+Make+Log+Compaction+Point+Configurable > The Jira ticket KAFKA-1981 Make log compaction point configurable is here:

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

James, Your pictures do an excellent job of illustrating my point. My mention of the additional "10's of minutes to hours" refers to how far after the original target checkpoint (T1 in your diagram) on may need to go to get to a checkpoint where all partitions of all topics are in the uncompac

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

that are not "committed" > yet), we continue reading to the log end until we get to a consistent > state. > > I am not convinced the new functionality is necessary, or even helpful. > > Gwen > > On Mon, May 16, 2016 at 4:07 PM, Eric Wasserman > wrote:

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285617#comment-15285617 ] Eric Wasserman commented on KAFKA-1981: --- Thanks, I added your use case. I w

[DISCUSS] KIP-58 - Make Log Compaction Point Configurable

I would like to begin discussion on KIP-58 The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-58+-+Make+Log+Compaction+Point+Configurable Jira: https://issues.apache.org/jira/browse/KAFKA-1981 Pull Request: https://github.com/apache/kafka/pull/1168 Thanks, Eric

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275920#comment-15275920 ] Eric Wasserman commented on KAFKA-1981: --- That did it. Thanks. I created h

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275024#comment-15275024 ] Eric Wasserman commented on KAFKA-1981: --- I think it must be the same as my

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274751#comment-15274751 ] Eric Wasserman commented on KAFKA-1981: --- I attached a KIP to this Jira ticket

KAFKA-1981 Make log compaction point configurable

I was requested by Ismael Juma ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=ijuma) to create a KIP for this patch because it adds configurations. I don't have the permissions in Confluence to add a child to the KIP page as instructed. Instead I added a markdown document as an attac

[jira] [Updated] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated KAFKA-1981: -- Attachment: KIP for Kafka Compaction Patch.md Attached a KIP as I cannot add one in Confluence

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250643#comment-15250643 ] Eric Wasserman commented on KAFKA-1981: --- I apparently don't have any priv

"nag" for Pull Request

Following the advice on http://kafka.apache.org/contributing.html > this email is a "nag" for the PR https://github.com/apache/kafka/pull/1168

contributors list

Kafka contributors list so that I can assign the Jira issue to myself. I have already corresponded with Jay Kreps about the issue so I'm fairly optimistic that the PR will be on the right track. Regards, Eric Wasserman